Is the EIDR worth it for a small budget film?

Yes. The EIDR is what makes your title discoverable on Google and readable to the industry's databases. Even a short or independent film benefits from surfacing in search with the right credits and reading as a real release — for a one-time investment.