Go slowly, he'll be terrified for a while. It's scary moving to a new place.
I'm currently working on bonding with my new two babies. Put a piece of fleece over the top of his cage, he'll feel super safe if he has a nice roof.
Don't be too loud or try to grab at him, he needs to learn that you're his friend, not a predator.
Put your hand in the cage and let him sniff it for a few minutes every day, he'll slowly learn that your hand is a safe place.
Put some food in your hand, he'll learn that your hand has food and is safe.
Petting won't be for a little while, my Daisy took months, my Sasha will allow slight petting (after about 3 weeks with her) and my Lucy won't allow any touching whatsoever (after 3 weeks). It depends on the chinchilla.
In a few weeks you could probably take him out of his cage and let him run around with you, but be careful, make sure he's ready. You'll know hes bonding with you when he'll sit on your hand and eventually come out to see you.
Bonding is worth it, soon enough pippin will be hopping on your shoulders, he'll be excited when you walk into the room and maybe he'll even accept scritches ^_^
I find that treats help the trust a bit
Some rosehips or cheerios will get your little buddy to be more friendly, but don't overdo it! He could get fat, and eventually get problems with too many treats.
As for food, make sure he has lots of food all the time. Chinchillas eat a little bit at a time and should always have fresh food. Don't throw out the old food unless hes peeing/pooping in it, or if its a few days old.
Oh! Does he have a hidey house? Any kind of place he can hide would be good. He might not use it, but he'll be more comfortable knowing he can hide if he needs to.