A video comparison by Adrian Nier shows that the iPhone 3G performs significantly slower on iOS 4.0.
Camera Launch: 40% slower
Camera Shoot: 54% slower
Settings Launch: 125% slower
Safari Loads NYT: 37% faster
Also please note that if you decide to jailbreak and enable multitasking this will make your iOS 4 device even slower!