Knex: Timeout acquiring a connection

Devtools ComposeDB
1

I’m getting some errors in my logs that some anchoring fails due to a bad request from the clay server. It seems like the server was overloaded or something as it says the pool is probably full. I think maybe this could cause the CACAO expired errors we’ve been dealing with before, so wanted to report this in case it needs to be looked into. These are the logs:

Oct 30 19:06:30 discourse-graph-demo ceramic[31031]: [2022-10-30T19:06:30.471Z] WARNING: Anchor failed for commit bagcqceraxek6uqj3bxpvgbujwqdt7ao26w2unzoig5fzfmviyzzfwow5wf3q of stream kjzl6kcym7w8y6m7gc6xlapspgeo260wlsa6dhi8ryq4ajvljtnbx1fly28fj01: HTTP request to 'https://cas-clay.3boxlabs.com/api/v0/requests/bagcqceraxek6uqj3bxpvgbujwqdt7ao26w2unzoig5fzfmviyzzfwow5wf3q' failed with status 'Bad Request': {"error":"Loading request status for CID bagcqceraxek6uqj3bxpvgbujwqdt7ao26w2unzoig5fzfmviyzzfwow5wf3q failed: Knex: Timeout acquiring a connection. The pool is probably full. Are you missing a .transacting(trx) call?"}
Oct 30 16:46:06 discourse-graph-demo ceramic[31031]: [2022-10-30T16:46:06.213Z] WARNING: Anchor failed for commit bagcqcera2jdme27qzuan5w3vn7tkzqsfk2dstnvl2tw3nmuvxub4d3bsrd4q of stream kjzl6kcym7w8y9c18xtd4e4tcm5m9qx263rql9tz7u5q59etcp0suxmiood5xwo: HTTP request to 'https://cas-clay.3boxlabs.com/api/v0/requests/bagcqcera2jdme27qzuan5w3vn7tkzqsfk2dstnvl2tw3nmuvxub4d3bsrd4q' failed with status 'Bad Request': {"error":"Loading request status for CID bagcqcera2jdme27qzuan5w3vn7tkzqsfk2dstnvl2tw3nmuvxub4d3bsrd4q failed: Knex: Timeout acquiring a connection. The pool is probably full. Are you missing a .transacting(trx) call?"}
Oct 30 16:22:41 discourse-graph-demo ceramic[31031]: [2022-10-30T16:22:41.625Z] WARNING: Anchor failed for commit bagcqcera7sv7okibecewmyr32xx3uwvcj2j62e7anuats4hf32j54gynexna of stream kjzl6kcym7w8y5idp4mfqave7vs9ose3h76llhwmuwe6xnpzt8qhjpejvhpr3a4: HTTP request to 'https://cas-clay.3boxlabs.com/api/v0/requests/bagcqcera7sv7okibecewmyr32xx3uwvcj2j62e7anuats4hf32j54gynexna' failed with status 'Bad Request': {"error":"Loading request status for CID bagcqcera7sv7okibecewmyr32xx3uwvcj2j62e7anuats4hf32j54gynexna failed: Knex: Timeout acquiring a connection. The pool is probably full. Are you missing a .transacting(trx) call?"}
2 Likes
2

Thanks so much for reporting these, @nax :pray:t3:

We’ll take a look.

3

As you asked for the other issue you reported, mind adding this to Github issues as well?

4
5

Hi @nax,
Are you using SQLite as your ComposeDB backing database, or PostgresQL? If SQLite, could you try switching to Postgres and see if that fixes things?

6

Hey @spencer,

Yes, I’m using SQLite. Happy to move over to PostgreSQL, would this cause data loss when switching?

7

Your index database will be lost, so the data created before the switch won’t show up in ComposeDB queries. The actual underlying streams in Ceramic will still be there though, so you could load each stream by StreamID manually, which will re-populate them into the index database

1 Like
8

Hey Max, any luck with Postgres? Did that solve your issue?

p.s. let us know what other issues you have!

9

Hi @avi,

We aren’t able to switch to PostgreSQL yet. I spoke to Artur in London and he mentioned that you will be adding historical data sync sometime soon, which would enable us to create a new node using PostgreSQL and sync the model data. So I figured we would wait for this.

I will create a post shortly about another issue we’re facing. It’s more of a question though than an issue.

Thanks,

Max

1 Like