The biggest downside of Audible is that the membership can feel poor value if you do not use the credits or included listening regularly.
That weakness matters because the service works best for consistent audiobook listeners, not for people who sign up with good intentions and then barely touch it.