I think a “smaller” animated feature has a much smaller appeal. Some people might also turn down any animation all together (see, my parents), so having such a tight niche can be a bit harsh in the box office. The upside is that smaller animated films could have a much more dedicated fanbase, like that of the Nightmare Before Christmas.