Rubin was born in Monroe, Louisiana, the son of Sam and Eileen Rubin.^[1][2] He attended Neville High School, lettering three years in football (winning all-district honors as a running back and punter), baseball, and basketball and twice in track.^[3][2]

In 1976, Rubin began playing for the LSU Tigers football team as a running back and punter.^[3]

Following the 1977 season, he transferred to Northwestern State University, where he was a punter and a tight end, and received his B.A. in 1981.^[4] While there, he played alongside future NFL players Bobby Hebert, Mark Duper, Joe Delaney, and Gary Reasons.^[2] In 1979, he set a school record with a 75-yard punt, and was named to the Jewish All-American team.^[3]

Rubin began coaching as a graduate assistant at Northeast Louisiana University in 1981. He became assistant strength coach the following year. In 1984, he was promoted to strength coach and remained in that position until 1985. After serving as strength coach at LSU from 1987 to 1990, Rubin returned to Northeast Louisiana University in 1994.

In 1995, Rubin was hired as strength and conditioning assistant with the Green Bay Packers.^[3] While serving in that position, he was a member of the Super Bowl XXXI champion Packers, as well as the team that won the NFC Championship the following year. He was promoted to head strength and conditioning coach in 1999.^[3] Rubin remained with the Packers until 2005.^[3]

In 2010, he was named head strength and conditioning coach of the Philadelphia Eagles.^[3] He later assumed the same role for the Kansas City Chiefs, after Andy Reid was hired there as head coach. In 2019, Rubin won Super Bowl LIV when the Chiefs defeated the San Francisco 49ers 31-20.^[5] In 2022, Rubin won Super Bowl LVII when the Chiefs defeated the Philadelphia Eagles 38-35.

In 2003, Rubin was inducted into the USA Strength and Conditioning Coaches Hall of Fame.^[6] He was inducted into the Northwestern (La.) State Hall of Fame in 2014.^[4]