You might think that your late arrivals bothered him, for the simple reason that he could only chat with you on Fridays and when you arrived late, the time they could spend together would decrease. This could be causing him uneasiness or anxiety and was leading him to fall into a vice such as smoking. God wants to find a way to occupy his time in an activity that will generate income and keep him away from any vice that may affect him.