working again - kinda
what a week. the old nodejs project from 6 months ago actually fired up and started running with minimal effort.
my dev server died so have to run it on my crappy dev box, i didnt have a mongo user set up - so sit took a few web searches to figure it out but other than it the scraper still works.
I did find a small buggy part and managed to fix it.
NOTE: when reading large csv files - file system function createReadStream() only gets chunks and so it was breaking the csv. I had to switch to using modules readline and stream.
That fixed the broken read and i went from 99% accuracy to 100%.
Now I just get to wait around till the phone call next week.
That sucks getting paid to wait around.
At least I have the chance to make a few bucks.
Being disabled makes it really hard to maintain normalcy.
The gist of the project is
1)end user uploads specific formatted csv
2)dump csv into mongo db
3)scrape a website with queries from csv data (using proxies)
4)insert updated prices(w/ timestamp) in db
5)user downloads updated csv
todos
1)update webpage UI/UX for display/search/filter of data
2)add ticker (db has price data w timestamps so we can watch prices over time)
it's a fairly small project so should go quick.
who knows, it may lead to something longer - the owner is considering blockchaining the back-end for logistics.
Well, I'm gonna go see what I can break next.
remember ; you gotta break a few eggs to make an omelet.
The easiest way to help the broke carpenter is an upvote and maybe a resteem.
The next best way is to sign up for the fucking fastest dex on the planet - bitshares - https://wallet.bitshares.org/?r=rxhector2k5
projects you may end up funding
better server
better network equipment (better switch/router)
better drives (need storage space on servers - thinking about a boinc node)
future servers/vms
need to run a bitshares node
need to run a steemit node
investigate eos
colocation = $650/mo
server = ????; (cluster @$5k/ea)
bills = $2k/mo
unemployment ain't gonna fix that
i got a few website/gamification ideas - but need to get network and nodes running better before jumping back to development environment
[manna]
https://www.mannabase.com/?ref=38c7fefa79
[basic income]
https://steemit.com/basicincome/@steembasicincome/steem-basic-income-a-complete-overview
https://steemitimages.com/0x0/https://steemit-production-imageproxy-upload.s3.amazonaws.com/DQmYyGi4HvKXuvQJ7sWPQHH5W33ThfAE74dpsJgMJ6n8UiZ
[whaleshares]
#life #of #a #broke #carpenter #posting #ulog #for #steemit #basicincome
© rxhector
peace ;)