@CyrilSebastian,
The very first was the Pacific Railroad/ Overland Express. Officially completed in 1869, it connected a number of networks, including the growing network of lines from California and the already established lines from the east coast.
www.tcrr.com for more railroad information.