Wall Street's main indexes ended modestly lower on Thursday in a choppy session as hawkish comments from a U.S. Federal Reserve official and data showing the labor market remained tight led some investors to worry about more aggressive interest rate hikes.