Votes Database 80GB - Index Not EnoughsteemCreated with Sketch.

in #witness-categorylast year (edited)

I have observed that some APIs take longer and longer to complete which results in timeout.

The votes DB is now more than 80GB.

image.png

Adding Indices is simply not enough.

image.png

I know the SQLite isn't a good choice here, but didn't have time to rewrite and migrate the data to MySQL or Posgres.

So, for now, I'll investigate how I can improve the Query Efficiency by possibly optimising the SQL or bringing in an extra layer of caching.

Steem Blockchain

Steem to the Moon🚀!

  • You can swap the STEEM/SBD to Tether USDT (TRC-20) via steem2usdt!
  • You can swap the STEEM/SBD to TRX (TRON) via steem2trx!
  • You can swap the STEEM/SBD to BTS (BitShares) via steem2bts!
  • Register a free STEEM account at SteemYY!
Sort:  

!ask how to optimise sqlite query?

Check this post: How to Optimise SQL Queries? Quick Tips


command: !ask is powered by witness @justyy and his contributions are: SteemYY.com
More Commands are coming!. !ask is currently based on ChatGPT-3.5

!test !thumbup

Hello @justyy! You are Superb!


command: !thumbup is powered by witness @justyy and his contributions are: SteemYY.com
More Commands are coming!

Do you have a problem with your load balancer?
grafik.png

Too many requests today.

Coin Marketplace

STEEM 0.16
TRX 0.16
JST 0.032
BTC 58495.14
ETH 2461.74
USDT 1.00
SBD 2.36