Do you remember the stories Usopp told to Kaya to cheer her up? The reason the giant gold fish seemed familiar to Usopp was because he told a made up story about finding a gaint gold fish and that it's poop was so big the he mistaken it for an island (which is also what happened to the giants, they landed on the poop thinking it was land)