The bookseller got a short-lived boost after Borders filed for bankruptcy in 2011 but wasn't able to maintain the growth.