Sources close to the production say that Kevin Costner, who stars in the hit Paramount series, will not be returning to the show after its fifth season.