@kacieaurore,
Almost all the french groups around here celebrate St. Jean de Baptiste day, Bastille Day and 'cabanes à sucre' - festivals for maple sugar. If you google these you may get some more ideas.
There is still a bit of land owned by the French on the east coast. St. Pierre et Miquelon are two small islands, in between NFLD and Nova Scotia. The first french settlers came to NS 400 years ago.
They are known as the Acadiens or as Cajuns down in the Bayou. There is also the Quebecois and the Metis. Each of these groups have interesting cultural customs, music and food.
Here are a couple of songs, fairly typical of traditional French Canadian music. It sounds kinda Irish, you can hear the step dancing as a beat. There might even be a couple of spoons in the mix.
The Bottine Souriante.
http://www.youtube.com/watch?v=qMc-6MVEHF8
http://www.youtube.com/watchv=NE6m0hcb46s&feature=related
La Volée d'Castor - the Happy Beavers.
http://www.youtube.com/watch?v=Diga4z3zW4c
This is some French/Creole music from Louisiana, it quite different but you can hear the same roots.
http://www.youtube.com/watch?v=arCyTy6DKGQ
Hope this gives you some direction.