Improvements to database file updating script for the CPU_QuickMag Gridcoin CPU performance estimator

in #utopian-io3 years ago (edited)


Few days ago, @Nexusprime developed a very good script called CPU_QuickMag to estimate the magnitude (which you can multiply 0.225 (can be changed from time to time) to get the estimated GRC per day) of all whitelisted projects. While this repo is quite a breakthrough based on the fact that GRC PoR miners did not have a quantitative way to test expected Mags except for testing all of the projects manually until this came out.
However, I have found a room for improvement for the initial update of the database for various scripts. In the file, which downloads the team and host statistics database, there is no option to see if a download failed, or the speed of each download. Especially, some database files are larger than others, so we would have to wait without knowing if a download failed, or it is just downloading slowly.


Instead of showing just the percentages of the download based on how many downloads out of all are finished, a more verbose way is to show part of the wget download process in stdout. Therefore we can find out if a download has not failed, after setting an additional option such as -v during script execution. After downloads are finished, the wget messages may be erased and some new download messages can be shown. If downloads fail, the script should detect the failed download and then restart the download automatically, so that people do not have to rerun the whole script and download all of the databases again.

Mockups / Examples


After the problems related to unknown downloads are resolved, people may now check the status of their downloads and see how the downloads are running. They may also see how their downloads restarted after some kind of an internet problem stopped the downloads. Also, you can see how much time you have left until all the download terminates.
Thank you very much.
EDIT: @Nexusprime stated that the download does not hang indefinitely, so fixed related information.

Posted on - Rewarding Open Source Contributors


Thank you for the contribution. It has been approved.

You can contact us on Discord.

Hey @rosatravels, I just gave you a tip for your hard work on moderation. Upvote this comment to support the utopian moderators and increase your future rewards!

This post was upvoted by Steemgridcoin with the aim of promoting discussions surrounding Gridcoin and science.

This service is free. You can learn more on how to help here.

Have a nice day. :)

Slight clarification. If the download crashes or times out, you will not hang indefinitely. If the progress % is still on screen then at least one download is still making progress (probably very slowly).

If you want I can put the progress bars back in as a debug mode, but it will be very visually unappealing.

I experienced this when downloading for WCG, and I found out that basically the only way I can find how downloads are going is the system monitor. Even there, I couldn't know if the download was going slowly or there was a problem. I posted this post because I thought that explicit is better than implicit. I think adding a -v or --verbose option for this would be quite good in this case.
Again, thank you for making this script!

It is in as debug and as -v. Its really not what you where hoping for.
I can make it look nicer based on the same code, but it will add 30% to time for the script to finish.

I'll have to rewrite the script in its entirety to keep the multi-threading and get individual progress bars.

If there is a debug option, that will be good for most people now, since the program needs a major renovation. After all, this is just a suggestion. :)

Congratulations! This post has been upvoted from the communal account, @minnowsupport, by ehf from the Minnow Support Project. It's a witness project run by aggroed, ausbitbank, teamsteem, theprophet0, someguy123, neoxian, followbtcnews, and netuoso. The goal is to help Steemit grow by supporting Minnows. Please find us at the Peace, Abundance, and Liberty Network (PALnet) Discord Channel. It's a completely public and open space to all members of the Steemit community who voluntarily choose to be there.

If you would like to delegate to the Minnow Support Project you can do so by clicking on the following links: 50SP, 100SP, 250SP, 500SP, 1000SP, 5000SP.
Be sure to leave at least 50SP undelegated on your account.

Hey @ehf I am @utopian-io. I have just upvoted you!


  • You have less than 500 followers. Just gave you a gift to help you succeed!
  • Seems like you contribute quite often. AMAZING!


  • Contribute more often to get higher and higher rewards. I wish to see you often!
  • Work on your followers to increase the votes/rewards. I follow what humans do and my vote is mainly based on that. Good luck!

Get Noticed!

  • Did you know project owners can manually vote with their own voting power or by voting power delegated to their projects? Ask the project owner to review your contributions!

Community-Driven Witness!

I am the first and only Steem Community-Driven Witness. Participate on Discord. Lets GROW TOGETHER!


Up-vote this comment to grow my power and help Open Source contributions like this one. Want to chat? Join me on Discord

Hello, as a member of @steemdunk you have received a free courtesy boost! Steemdunk is an automated curation platform that is easy to use and built for the community. Join us at

Upvote this comment to support the bot and increase your future rewards!