Skip to content
Cosmopediaby Unity Nodes
DiscussionsConversation2.5 million USD (about 350k) atoms between stride and the hubForum ↗

2.5 million USD (about 350k) atoms between stride and the hub

Conversation14 posts406 views6 likesLast activity Aug 2024
JA
jacobgadikianOP
Aug 2024 1

I should not need to be writing this.

But nobody else did.

There are 2.5 million USD of atoms (about 350k) stuck between stride and the Hub.

Most likely the problem has something to do with gas configuration that changed when the fee market was added to the hub.

Certainly there’s been more than enough time to inform users of this.

Neither the hub team nor stride bothered to do so.

x.com

questions

  • When was this issue known?
  • Was stride informed of changes to gas?
  • Why has there been no information provided to users?
RO
RoboMcGobo
Aug 2024 2

Hey Jacob! Thanks for raising this. I mentioned to you this morning that I needed to chat with our eng team to get a bit more context. I have that context now and we’re working on a broader post with all of the details, but here’s some background: x.com Vishal | Stride (@shellvish) on X @shellvish @AnonNgmi @interchainriley @WhisperNode We’re writing up a more thorough explanation right now, but the gist of the issue: - Hub gas limit was 100M per block - Latest Hub upgrade added x/feemarket, which limits individual txs to 30M gas. The block gas limit is unchanged, but ICA messages are now limited to 30M gas - and a TLDR for non-technical folks: x.com Riley | Stride (@interchainriley) on X @interchainriley @AirdropGlideapp Quick explainer for anyone wondering: All unbondings are safe and will process, some are just delayed due to an upgrade on the Cosmos Hub that interacted with the handling of LSM shares. Most unbondings processed normally and all funds are safe, this only delayed some users' We definitely weren’t trying to hide anything, in this case we’ve been in touch with…

Excerpt (1195 of 1574 characters). Read the whole post on the forum ↗

JA
jacobgadikian
Aug 2024

But impacted users were every staked atom user, if they tried to unbond.

RO
RoboMcGobo
Aug 2024 1

Not quite. It only impacted certain undelegation batches that involved an excess of LSM liquid stakes. Here’s the explanation from Vishal’s tweet:

Normally, this wouldn’t be an issue, but Stride accepts LSM delegations on the Cosmos Hub. The way this works today is Stride accepts the delegations, then rebalances+undelegates afterwards towards Stride’s target delegations (subject to standard Cosmos SDK x/staking restrictions). Depending on the LSM delegations that Stride has, unbondings can stochastically fail. In particular, sometimes Stride will try to unbond from 35-40+ validators, which consumes > 30M gas

Most undelegations processed as normal. The larger impacted users reached out to us and we’ve been talking with them directly.

JA
jacobgadikian
Aug 2024

And the smaller impacted users?

What was done to warn them?

Like this guy

x.com

Lincoin 🛡️ (@lincoin_x) on X

@gadikian @informalinc @stride_zone @RoboMcGobo @cosmoshub The prop 248 (stride chain) was approved on Saturday, a few hours before the next batch was to be sent, but Unbonding didn't happen, now we don't know what was the problem.

Here is a good example of a footgun warning, from Penumbra

x.com

penumbra 🌘 (@penumbrazone) on X

The Penumbra Labs team has discovered an issue that results in not being able to withdraw USDC from Penumbra. While the PL team investigates, users should not perform USDC transfers out of Penumbra. When a fix is found, a patch will be released.

See how it leads people away from danger?

I think that is a good approach.

Because there was absolutely legitimate danger.

People really do not like to be suddenly unable to access their assets.

And that’s really very sensible.

Yet the dashboard shows: “all good yo”

That’s a huge footgun left for users. It does not need to be there.

RO
RoboMcGobo
Aug 2024

Anyone who was impacted and opened up a ticket has gotten help from our support team (including, AFAIK, the user that made this tweet)!

I definitely can appreciate the point that we should have posted this on twitter or the status page, and we’ll be adjusting the way we handle these comms to do so moving forward. Re: the status page, this is due to a missing flag that we’ll be adding that should reflect this issue in the future.

JA
jacobgadikian
Aug 2024

Informal was aware of this problem, and did not inform the user community?

RO
RoboMcGobo
Aug 2024

I can’t really speak for informal on this, I just have context on the actions we’ve taken at Stride to help get these edge-case undelegations “unstuck” (so to speak).

JA
jacobgadikian
Aug 2024

Do you think that stride has been given stable platform services ?

JA
jacobgadikian
Aug 2024

How about that peg? We have invested so heavily in it But now, statom isn’t redeemable in some cases. And it has been that way for a month. But the community only learned of this today. Except some knew much earlier. Why was I told today that stride is not broken on the hub? I don’t get it, the present situation is fully incompatible with that claim. Since there are users who are aware of this, and users who aren’t, is it possible the information was bandied about in a privileged manner that allowed some access to the exits faster than others? That… Seems certain to me. @RoboMcGobo are you saying that this condition existed, and Stride did not speak to informal? …well that would be quite bad, deeply irresponsible even. Otherwise, I think it is essential for atom holders to know when informal knew that their upgrade had broken redeemability. @jtremback so… When did you learn that 330k statom were stuck? What did you do to address it? Did stride inform you? Why can’t I get answers to basic questions? x.com @ I am not a security researcher. …at least that’s a really popular claim at informal. Why did I…

Excerpt (1196 of 1653 characters). Read the whole post on the forum ↗

JA
jacobgadikian
Aug 2024 1

So, let’s see what’s happened:

I spend a full day finding out what’s up

1000005896

Total silence from icformal and stride on the issues I think matter.

Status page be like:

That doesn’t make sense.

Why does no one care that users are losing their shirts?

x.com

Jacob Gadikian 🐳⚛️⚗️ (@gadikian) on X

Hi, @stride_zone @JTremback @informalinc I have heard nothing back from any of you regarding the stuck atoms. Stride is broken and it is a vital part of the hubs economic security. Since: 1) stride is broken for sure 2) you tell me it isn't 3) there is no reply I am

I want to know:

  • Did informal ask stride not to say anything? (there’s a lot of precedent here)
  • When did stride speak to informal? (If they did not, well, yeah that would be strides fault big time)
  • What has informal done to help?
  • Why not param change gov prop on the hub, weeks ago? (I am NOT blaming stride here. Issue is solvable on the hub side, with ease, without guesswork)

I think that these are very reasonable questions to be asking at this time.

JA
jacobgadikian
Aug 2024

Further oddity.

Just learned that stride is not sure if they told informal anything at all.

For a month.

While user funds are stuck.


that doesn’t make sense and this most certainly isn’t misinformation

FH
FHZ
Aug 2024 1
jacobgadikian:

I should not need to be writing this.

But nobody else did.

Keep up the work, Jacobgadikian. Your work is extremely appreciated by, if not all, other communities of the Cosmos Hub.

JA
jacobgadikian
Aug 2024

Just wanted to post this so that everybody is aware, yesterday the stride status page did actually show that the funds were stuck.

It now shows all systems operational. If anyone has funds stuck, you should probably say so here, but as far as I know, stride is now working again.

Yesterday:

Today:

When there are issues like these, it is important that the community is made aware of them, because their assets can get stuck.

← Back to Discussions