RocksDB and SMTs Announcement

in steemit •  6 days ago

Dear Steemians,

We have estimated and prepared the detailed versions of our short- and long-term roadmap for RocksDB and SMTs with their target completion dates. To make everything come in shorter bursts and as the community has requested, we’ve broken out SMTs into SMT-lite, which is paired down to include the core functions of issuance and transfer of tokens. Additional roadmapped SMTs features are also listed.

Below is the spreadsheet outlining the different tasks for RocksDB and SMT-lite, as well as their ETA, points and status.

Screenshot 2018-12-05 at 4.38.04 PM.png

For RocksDB, our plan is to write an adapter that uses the BMIC (Boost Multi-Index Container) interface and replaces the behavior with a RocksDB backend. This will allow steemd to support both the existing BMIC/Chainbase implementation and RocksDB as a compile option without needing to change the consensus logic of steemd. Additionally, by creating the adapter to use the same interface as BMIC, we can leverage the existing BMIC unit tests to ensure that we replicate the expected behavior of BMIC, but backed by RocksDB. This will result in a 95%+ memory consumption reduction by moving our storage from memory to disk. Ultimately our target is to have Economic nodes (Full Nodes by a Bitcoin standard) running on commodity hardware with 4GB of RAM and a standard SSD.

The scaled-down SMTs scope includes these features: claiming names, tokens, issuance of tokens to one account, transfers between accounts, immutability (meaning that once a token is launched none of its original parameters can be altered) and a testnet.

Next iterations of SMTs will add back in these original functions:

Screenshot 2018-12-05 at 4.25.20 PM.png

Again, I will discuss these topics and your questions tomorrow during a livestream at 11am CST. See my post from Monday regarding submitting questions.

Best regards,
Ned

Authors get paid when people like you upvote their post.
If you enjoyed what you read here, create your account today and start earning FREE STEEM!
Sort Order:  
·
·
·
·
·
·
·
·
·
·

Hahahahahahahaha, that was actually a very funny response 😂

·
·
·

The pinned shows how pressured he is from the price drop

·
·
·
·

@atlantica, I think it just shows that he wants everyone to see it, as lately he's been accused of doing nothing.

Anyway glad to see SMTs haven't been completely shelved, and RocksDB sounds important. Ready for the next big rise I hope :-)

Cg

·
·
·
·
·

I am glad you are optimistic in this rough times

·
·
·

the square root of 69 is 'ate something' XD

·
·

I have tears in my eyes, are you joking?

·
·

·
·

I like the way you think LMAO! I'll be sure to have a my SMT-towel.

·
·

SMT-39 will be the answer

·

are you messing with time?

·
·
·
·
·
·
·
·
·

wow, that video was awesome, Imma spread it around a bit. Great Work!

·
·
·
·
·
·
·
·
·

All it took was a bear market and 70% layoffs.

·
·
·
·
·
·

Amazing how stuff gets done in a week or so when that happens.

·
·
·
·
·
·
·

The beatings will continue until the morale improves.

·
·
·
·
·
·
·

Exactly what I was thinking

Posted using Partiko iOS

·
·
·
·
·
·

Yeah I was thinking some people perform better with back against the wall. Clutch. I'm the same.

·
·
·
·
·
·
·

Hardened steel has to be forged in fire.

·
·
·
·
·
·
·

YES...

Necessity is "The MOTHER of INVENTION"...

We also need to be a bit less critical because ALL the cryptos ARE Being manipulated LOWER...

Have almost 40 years working/observing the financial markets and really can't find a single financial instrument globally, that is NOT being manipulated...

So let's PULL Together...

...in the same direction 4 Success...

Cheers !!

·
·
·
·
·
·
·

Look at STAR WARS (original release) vs. Phantom Menace.

·
·
·
·
·
·

Don't fool yourself. Are you serious?

·
·
·
·
·
·
·
·
·
·
·
·

And that only addresses the lack of revenue...

This proposal is like putting a band-aid on a bullet wound.

·
·
·
·
·
·

True. Haha...it's been going on for a while now

·
·
·
·
·

lol

·
·
·
·

Pretty cool video. Did you post this to your blog I would love to ReSteem it or spread it around!

·
·
·
·

Best thing i've seen all day!

·
·
·
·

Wow!!!!

This gets me so pumped!!

·
·
·
·
·

Reading my Posts are like getting hand fulls of Change...

·
·
·
·
·

wouldnt that be 'chain-ge'

·
·
·
·

lol that was quick.

·
·
·
·

haha nice video

·
·
·
·

Whoooa that was nuts! Rock on SMTs!!

·
·
·
·

What the heck! This was fast and awesome man! I really want to know how it was created :O

·
·
·
·

Welcome. We hope for the best

·
·
·
·

My new motivational track when I need to get some energy and hype to work :D

·
·
·
·

way cool

·
·

In 30 days? What do we have in 30 days? Are you serious? Take a look at the project planning. :)

This is once again a very big mind-fuck. Time will tell...

·
·

i could if you want me to

·

Ignorant oblivious dreamer...

·
·

Huh, a little reserved for you Bern. I specifically scrolled for your response... puts down popcorn

Hope you're good buddy! :-)

Cg

·
·
·

Haha, I did the same! Might have missed it all together if not for your comment.

Edit: Never mind Picks popcorn back up scroll down further for the entertainment ;)

·
·
·
·

Hee, hee, thanks for this, I would have missed that entirely!

Cg

·
·
·
·

To be honest, i don't understand what i just read. is SMT getting closer to completion already?
Help a chap

·

SMT full means say please?????

·
·

Smart Media Tokens.

Cg

·

SMT-b22 Soon 😏

Posted using Partiko Android

man....why don't you get along with Dan again and you guys could merge EOS with Steem......otherwise he creates steem 2.0 and we all get fucked up......doesn't matter who is the boss, better to be number 2 with Dan in charge and become a billionaire than be the number 1 and go bankrupt......no room for small coins....EOS and Steem must merge......he already proved he was right when he created a new coin from scratch and it got much higher market capital than steem....sell the control of Steemit Inc to Dan......you assure yourself finantially and assure the success of Steem. Telling this not to put you down in any way but to genuinely help you.....All the best

·

You got a 89.48% upvote from @brupvoter courtesy of @christianchannel!

·

I agree with you my friend!!

·

Sorry who is this Dan everyone is talking about? And what platform is he creating?

·
·

He was the architect of steem, he created steem.

·
·

Dan Larimer. He is now (or maybe he's already left it, too?) behind the project EOS. Steemit pretty much fell apart after he left last year. Though, as many of us hopefully know, correlation isn't nec. causation... but in this case, there seems to be a strong relationship nonetheless.., imo.

Ned, your wallet activity communicates that you are aiming to power down 100%. Since 1.5 Mil STEEM has already been uloaded into the market; a big question mark stands.

In my 40 years of capital markets and companies; the ONLY reason a CEO gets rid of his WHOLE stock of holdings is due to the following potentials:

  1. You are LEAVING or Giving Up out of disgust (unlikely).

  2. You have received another offer elsewhere that's too good to decline.

  3. The board is about to fire you (unlikely) since the board is you, yourself and you.

So, what's going on? There are many reasons a CEO sells and only one reason a CEO buys.

I'm smelling something having to do with #2....that you have somewhere else to go....perhaps not of your choice but necessity. Where are you going?

What have you done with Steemit Inc.? My sixth sense tells me that you're up to a self preservation driven activity.

I'm aiming at #2.....what are you scheming? What's going on that makes you unload your wallet? Did you sell Steemit Inc.? Is it going bankrupt?

I shall meditate on this to discern.

·

You are awake... Grtz... don't be fooled by all these gospel singers and mantra repeaters. Use your eagle eye.

·
·

touche

·

I'm also powering down 100% now, and that's not because I'm leaving Steem, it's just because it seems to be the only way to gain a bit of liquidity on the Steem power.

By powering down 100%, once a week I get some freedom of choice, I can choose to revert the power down by powering up, I can choose to sell some steem, I can choose to buy SBD on the internal market and convert it to steem if that seems profitable, and I can choose to channel funds over to other investments.

·

Transferring crypto to an exchange is not the same thing as selling. I myself have quite a bit of Steem on an echange that I use for regular trading. It might not be the most secure thing, since the exchange could be hacked, but it allows me to profit quite a bit from trading.

He could have done quite a number of things, including diversifying his crypto holdings to weather to bear market. The question is, if he has sold Steem, will he buy back any? Will he possibly increase his holdings?

In any case, it's not really our business what someone does with their personal holdings of Steem. Despite people's grumblings about people powering down, it is fully their own business what they do with their own finances.

Upvoted for the commitment to getting a simple token delivered; thank you. The greater concern here is probably the period of time proposed for the RocksDB work, since technical people seem to doubt it can be done that quickly. So I wonder at the actual price difference between what you are doing and what Blocktrades proposed to handle. But again, we need tokens and thank you for that commitment.

·

Commitment? The only thing delivered is a little beer mat with some writings on it.

30 days, what are the deliverables? Are you serious? We should be happy in 30 days he finished his powerdown, how many mind-fucks can you undergo?

I really like the new Ned. :)

"Ultimately our target is to have Economic nodes (Full Nodes by a Bitcoin standard) running on commodity hardware with 4GB of RAM and a standard SSD."
This is fantastic news and will benefit the Steem ecosystem enormously.
If Crypto prices had stayed high this would never have been a priority.
This is a perfect example of how going through tough times creates a much stronger & better result than being on easy street.
Well done and good luck in getting these initiatives completeted.

·

As the saying goes

thumbnail_IMG_7571.jpg

Hopefully the 3rd & 4th panel won't apply to us.

·
·

100% correct and nice graphic.

Posted using Partiko iOS

·

lol, you wished him good luck... you're evil.... :)

"Ultimately our target is to have Economic nodes (Full Nodes by a Bitcoin standard) running on commodity hardware with 4GB of RAM and a standard SSD"

You just got trolled, or better, scammed... how does that feel... fantastic news, or ? fake news?

·

This is absurd... that doesn't help the "ecosystem"...

It's far closer to repainting a house that's partially collapsed from termite damage and calling it a repair.

·

yes, agree more

Thanks for the update. If you make it possible to run a full node on a 4gb server I promise to throw in some ;)

·

This right here is why optimizing steem's core technology is so important

·
·

Server? Servers are in centralized datacenters. Shouldn't the end goal be the actual end users running nodes on their android phones? And on their gaming PC's. Bitcoin isn't mined only in datacenters. Steem nodes shouldn't witness blocks in only those locations either. That is a recipe for disaster.

·
·
·

Well I totally agree. The thing why I did say server is because I got a internet connection that is unreliable at the best and simply disfunctional at the worst of times.
If I would have something decent I would throw in additional pcs at my home.

·
·
·

A gaming PC can be a server and indeed a good one for blockchain applications with excellent single core speed. Servers don’t have to be I data centers. Once upon a time every business had them in their office.

Posted using Partiko iOS

·
·
·
·
·
·

You have just described Holochain. You can thank me later ;PP

·

me to. For sure!!!

Thanks for the update!

It would be great if you and the dev team would consider adding native support for NFTs based on the SIP001 spec here, right after the work on basic tokens is complete:

https://github.com/thesweatshop/tokenforge/blob/master/SIP/SIP001.md

Edit: please see my reply to smooth deeper in this thread for short overview

·

Hi @upheaver - I just wanted to say thank you for contributing to STEEM ecosystem, I think it's very impressive that you just voluntarily devote probably tons of your time to open this platform to new possibilities. !tip 100 hide

·
·

Tipping 100 STEEM - you're crazy, but the good kind :D

·
·
·

He just used so many words I don't understand, I had to!

·
·
·
·

Haha, I'll continue doing that. Apparently it works :)

·
·

Thank you, highly appreciated

·

NFTs are accomplished in SMTs by issuing SMT-lite of 1(one) token and 0(zero) divisibility. What are the differences in the approaches? Thanks.

·
·

My proposal allows for storing of custom json metadata inside each individual token by 3 different parties: the token issuer, the current owner and the dapp interacting with the token.

The specification document contains a walk-through example

·
·
·

Thanks. I'm fairly sure we'll achieve the goals (e.g. Support Steem Monsters Card Issuance) supported by those reqs with SMT-lite. If I'm incorrect, let us know where.

·
·
·
·

Using SMTs for NFT functionality would be a hack - while it might cover the very basics, the native enhancements I proposed would provide new capabilities and in turn enable new kinds of businesses/ecosystems to emerge.

·
·
·
·
·

What is functionally different besides the name? If there are missing features, particularly small ones like json fields, now is the time to hash that out with the developers and get them incorporated.

·
·
·
·
·
·

It's explained better when reading the spec, in short there are a few things:

  • native apis for nfts (querying, issuing, burning)
  • separate storage inside each token for issuer's, owner's and dapp's data - they can write only to their own section.
  • a new mechanism for users to send NFT tokens to third party dapps (similar to a smart contract)
  • for those apps to consume/process token interactions asynchronously using queueing

This enables powerful new ways to build apps.

For example you could send your steemmonster cards to a real time strategy game dapp built by a 3rd party, play with them,earn custom points, and then convert those points to native experience points by steemmonsters - all data logged nativelly inside the token

·
·
·
·
·
·
·

Yes I understand your spec does things in a different way. Since you worked on your own to design something, and there are always different ways to get to the same goal line, it will clearly be different in terms of details such as the names of the APIs.

What I'm trying to drill down to are the core functional differences that can bridge the gap because I think there is near zero probability that the Steemit devs are going to implement your spec, but actually decent probability they might be convinced to make some small functional changes to enable the same or similar use cases.

For example, having data storage areas seems like something might be possible to go into even simple SMTs. If it goes in, many of the uses cases you have in mind will be enabled, if not using the same APIs that you specified, etc. If not then those use cases won't be able to use SMTs (or certainly not as easily)

·
·
·
·
·
·
·

Thank you for your explanation here. I didn't quite get the benefit when I read your post and glanced over the documentation.

·
·
·
·

Good job @ned . I really like it, how fast you react and how you start communicate with the community!

·
·

Ned I love the work you are doing and especially that you are listening to the community. That allows everyone to advance.

Ultimately our target is to have Economic nodes (Full Nodes by a Bitcoin standard) running on commodity hardware with 4GB of RAM and a standard SSD.

I am SO excited by this. Increased decentralisation!

Rise of the many nodes! Can't wait. Any word on CPU requirements / core count targets? I'm not about to run out and buy hardware today, but it would stop me from selling some other hardware I have lying around. :)

·

You can run the smoke blockchain on 4gb Ram.. :) Perhaps steemit inc takes note and removes the cancer that is SBD.

·
·

Smoke also has almost no content and state. A brand new blockchain can run on a Raspberry Pi.

This is huge news for our #OneLoveDTube community, a few of our RPC node dependant projects are having a hard time currently and with those resource requirements we could run our own node off the servers we have already 💪

Posted using Partiko iOS

Good job @ned . I really appreciate how hard the changes must have been this close to Christmas, but I understand critical situations call for serious solutions. I am very happy to see how fast things are moving the and increased focus on deliverables, communication and the discourse in the comments.

When you hang around people all day that talk like this you start to think all this jargon is normal. There were so many acronyms in this post I thought you were speaking another language. You need like a glossary for your posts perhaps. haha

But that said i'm happy to hear SMT is coming along we'll see to it that we can support SMT projects on @steempeak

·

lol - I just read many things I do not understand once again. My accounting degree, MBA and CPA are useless here.

This place never fails to amuse and I hope it survives. I just pray all the big guys get it together. I will keep posting weight loss work and helping tiny fish as long as I can.

·
·

Someone walks in and wonders why the heck you're helping "tiny fish" hahaha

·
·

Lol .. you are funny.

Posted using Partiko iOS

·
·
·

Why thank you! I amuse myself :)

·
·
·
·

The amused survivor :)

·
·

:-) Indeed

·

The way I look at it this that SteemInc may well speak their own language, but at least now they are attempting to use it to communicate to others outside of SteemInc!

·
·

Is someone outside of steem gonna understand all those very very steem acronyms?

·

Exactly my thoughts @jarvie - wouldn't a glossary under the main dropdown menu on everyone's account page a be a good idea? Or is there perhaps already one somewhere amongst the FAQs items?

·

At least we have @upheaver to explain it to us!

·
·

He's much easier to understand. haha

I have never been more excited about Steemit then I am right now. Thank you Ned for your decision making in the past few weeks.

Thank you for your continued best efforts @Ned!

First of all, this update made my day!

Second, I know very little about development so this question is from a layman's point of view. There are many of us here, so I hope my question will help my fellow novices to understand this process better.

I am thrilled that the two most essential elements are going to be addressed. Is there any way to work on them at the same time so they can both launch asap? Could one of the two elements be outsourced to experts in the community or industry so they can be completed more quickly?

Thanks for the update, @ned. Love the idea of SMTs-Lite.

But does the focus on rocksdb mean that the offer from blocktrades is off the table? I mean, currently time is of essence.

But anyway, I'm trusting in your and the team's judgement. Looking forward to the live stream.

·

As I also replied to Asher:

“To be honest, Blocktrades should develop it and release it as a public repo.

That’d decentralization.”

It’s time to decentralize rather than always needing answers of the same unit. It’s time to put the learn in the flearn. Otherwise the same risks happening over and over again. Rinse and repeat.

·
·

It’s a crap ton of work that if not approved is a huge loss.

·

"I mean, currently time is of essence"

What do you mean with that? 30 days ... ?

·

this was the exact same question I had, so I shall toss 10% upvote to my friend @therealwolf and hope that this question is answered. With that said, I am looking forward to the stream and the Q&A portion - everything looks like it is going well!

Cheers

  • WinD

ammm i didn't know @ned can do pin posts ....
is there an option to do it in my profile ?

·

No. Anything goes for the management. Fuck any sort of system or order.

·
·

ammm hope they will add it to users soon

·
·
·

They won’t. It was just done so “Ned” can keep everyone from leaving, I suspect.

·
·
·
·

How is this post different from the last 50 times promises and dates were made and failed. You know, like "live stream tomorrow" and "post and make money"

Yet here we are, with all the usual hypnotized, kool-aid drinking, cult members kissing @Ned's ass as usual. And such an ass he is.

·
·
·
·
·

soon (tm)

·
·
·
·
·
·

"these are goals, not promises" - @Ned Scott.

·

Was wondering same thing. That is no bueno. Everytime I pop back into my account, shit is just getting worse, not better :(( I am migrating everything over to Holo/ Holochain, for they are doing what I envisioned everyone else to be trying to do, yet are actually doing it. Feel free to join me; thank me later.

Are you considering @blocktrades offer to take the RocksDB implementation? The above seems to point to a 'no, thank you'.

Cheers.

·

Seems that Ned wants his scaled-down company to do it all...since they continue to deliver in such a stellar manner.

https://steemit.com/blocktrades/@ats-david/re-blocktrades-blocktrades-rocksdb-proposal-to-steemit-20181206t002628784z

·
·

Upvoted, a real example of using reasoning and not wishful thinking.

·
·

Ah right, thanks for the link.

Well I hope this doesn't put other people off offering to to help, I thought this one might be a goer :/

·
·
·

that issue is at least a year old, and no one stops them to develop it and have a PR.
Like everybody else.

·
·
·
·

They'd like to get paid for that work.
Like everybody else.

Steemit burnt millions failing this far. Nobody is gonna do free work for them now, when compensation in turn is unlikely at this point. Developers of this caliber charge significant consulting rates. Ned had a bunch on staff, which is ordinarily cheaper than consultants. By a magnitudinal scale, but he fucked that all up, and nobody is going to do his homework for him now for free. He still has millions - he better hire somebody that can fix his fuckups, because most of the people who would have contributed for free, left last year or the year before, after witnessing the centralized incompetence.

·

To be honest, Blocktrades should develop it and release it at a public repo.

That’d decentralization.

·

Looks like Steemit Inc listened to my advice 🙃 I was one of the few telling them a no thanks to the expensive BT deal.

·
·

That advice came out of nowhere.
They should do it like everybody else, PR and have the consensus decide, what is best.
At least, they could still vote against SMTs, if they are not happy with the current solution, but they didn't do it in the past, so I doubt they will do it

·
·

Yes I saw you were not keen.

Only Steemit Inc can accurately assess the offer against doing it themselves - let's hope the right decision was made.

@Ned have you also considered FPGA acceleration of the blockchain replay? It is heavily CPU single core bound and likely involved many steps that would benefit from FGPA acceleration. I have these $275 Acorn 215 FPGAs from Squirrels research based on Xinlix Artix 7 FPGA that I'm interested in seeing whether they can be used to accelerate Steem node replay times. The main tech guy there @gpuhoarder on Discord thinks its possible.
tf4cts5suh.png

Why is @berniesanders downvoting this? What the hell is going on over here? Why is this post hidden due to low ratings? WTF is going on the Steemit Blockchain? I am shocked

·

You’re shocked I think @ned is full of shit? That’s nothing new. He’s NEVER delivered anything he said he would.

·
·

Is this a reason for downvoting him before mate? Maybe I am missing some background information, that's why I am asking you know

·
·
·
·
·
·
·

What did he do?

·
·
·
·
·

He pinned a post when nobody can do so...That is it. Nobody can pin post on its feed line but the developers can do. All failure seen...

·
·
·
·
·
·

I just saw that too, wtf is going on over here?

·
·
·
·
·

He didn't.

I'm sorry, just had to.

·
·
·
·
·

Not much of anything at all...except dump STEEM.

Keep up the communication Ned. We’re mostly very supportive of the hard work putnin by you and your team.

I don't suppose it matters if I ask for the third or fourth time for things to be explained in terms for regular users to understand instead of techno jargon alone, so... jazz hands?

·

My understanding is a leaner version of SMTs is under development and a new database system (rocksDB) is to be deployed which will hold a lot of stuff that had been floating around in RAM to be stored on disk. This should allow full witness like nodes to run on machines that will be much more affordable; which should help to further decentralize the network and make everything much cheaper to manage.

[NOTE: The above interpretation is open for debate and likely mis-interpreted in many areas. It is not meant as financial advice but Ned's post is making me feel very bullish. 😎]

·
·

Thank you for the clarification.

Posted using Partiko Android

·
·

Thanks! 😊

·

I agree I don't understand any of this...
@ned can you please put this in terms us regular guys will understand?

·
·

In short I ned laid off 70% of staff so they would no longer delay progress and we have viable ideas as to how to solve sustainability for nodes and we are working on SMT-lite So tokens can start to be distributed 😅

Posted using Partiko iOS