Get a French VAT number http://www.corlegal.com/francevat.html
Register for French VAT. Foreign companies registering for a French VAT number must submit their application with the French tax authorities. This must be done within a few weeks of the start of trading, or passing the VAT registration threshold. There are no penalties for a delayed French VAT registration. However, there may be interest charge on any VAT due.