Yes, you should tip Albertsons delivery. They are doing a service for you and it is always appreciated when you can leave a little something extra for good service.
While there is no set rule on how much to tip, a good rule of thumb is to 10-15% of your total order. So if your order came to $100, a $10-$15 tip is appropriate. You can also consider tipping more if your order was large or complicated.
Of course, you should only tip what you can afford and if you are unhappy with the service for any reason, you are under no obligation to leave a tip.
In conclusion, tipping Albertsons delivery is a personal decision based on the level of service you received. A good rule of thumb is 10-15% of your total order but you can always adjust the amount based on your own budget and satisfaction with the service.