Actually, they're not called "french fries" because they're from France--they're Belgian. "French" refers to the way they are cut ("frenched").
That, of course, makes the France-hating Congressional Cafeteria's changing of "french fries" to "freedom fries" all the more asinine.