AnyCable
Hey how to increase bytes size while js perform more than 16kb? #189
Closed
serhiihiba
started this conversation in
General
Replies: 5 comments 14 replies
-
Could you please add more details? (Log, errors, whatever). One suggestion is taking a look at the |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Hey @palkan thx for your suggestion, but it doesn't seem to help somehow |
Beta Was this translation helpful? Give feedback.
5 replies
-
|
Can you share logs from |
Beta Was this translation helpful? Give feedback.
-
|
Yes sure, seems the error is really with limit bytes, but now both params have bigger limits |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the logs! I double-checked the WS configuration: we actually need to set the |
Beta Was this translation helpful? Give feedback.
-
|
Hey mr. @palkan thx for your response and sorry for the delay😵 I finally tried your solution, but it doesn't seem to work😶🌫️ Procfile: |
Beta Was this translation helpful? Give feedback.
-
|
Also, @palkan i'm not sure, but maybe my js code may help somehow const el = document.getElementById("media_input");
const file = el.files[0];
if (file) {
const unitId = data.outputs.unit.id;
const reader = new FileReader();
const chunkSize = 1024 * 32;
const fileChunksSize = Math.ceil(file.size / chunkSize);
let sequenceNum = 0;
let offset = 0;
reader.onload = (event) => {
const chunk = event.currentTarget.result;
const isEnd = offset + chunkSize >= file.size;
const byteArray = new Uint8Array(chunk);
const arrayFrom = Array.from(byteArray);
const req = {
"actor": "ui__angry_cat_actor",
"method": "upload_chunk",
"required_component": false,
"inputs": {
"chunk": arrayFrom,
"offset": offset,
"isEnd": isEnd,
"sequenceNum": sequenceNum,
"fileChunksSize": fileChunksSize,
"unitId": unitId
},
"callback": {
"component": "ui--mix--uploading-component",
"actor": "uploading-component-actor",
"method": "updateProgress",
"resource_id": this.resourceId
}
}
window.Birdel.send(req)
offset += chunkSize;
sequenceNum += 1;
if (!isEnd) {
const nextChunk = file.slice(offset, offset + chunkSize);
reader.readAsArrayBuffer(nextChunk);
}
};
const firstChunk = file.slice(offset, offset + chunkSize);
reader.readAsArrayBuffer(firstChunk);
} |
Beta Was this translation helpful? Give feedback.
-
|
@palkan Still waiting if that's possible to solve😭 |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
Sorry, forgot about this one. It's a bit tricky to debug this issue without having a working demo code. One way you can help me with that is to dump the value of the Also, what is the |
Beta Was this translation helpful? Give feedback.
-
|
Hey mr. @palkan thx for your attention to this issue, I made a simple demo project to help you follow my steps by implementing this uploading feature |
Beta Was this translation helpful? Give feedback.
-
|
@palkan bump☝️ |
Beta Was this translation helpful? Give feedback.
-
|
@palkan bump 😵☝️ https://github.com/serhiijun/anycable_file_chunks |
Beta Was this translation helpful? Give feedback.
6 replies
-
|
I see 18 outgoing messages with chunks and 18 broadcasts with the progress. However, I also see that all outgoing messages are sent at the same time. |
Beta Was this translation helpful? Give feedback.
-
|
Tried a 25MB file—all went well. |
Beta Was this translation helpful? Give feedback.
-
|
Heyo mr. @palkan 👋 |
Beta Was this translation helpful? Give feedback.
-
|
Got it. Thanks for the explanation. I can reproduce it now. Will take a deeper look later |
Beta Was this translation helpful? Give feedback.
-
|
Okay, I checked and found that increasing 65536 is 64k, which should be enough; but it seems that the actual packet size is bigger than the chunk size (we send JSON with additional fields + ws protocol metadata). |
Beta Was this translation helpful? Give feedback.
-
|
@palkan Thank you so much for your attention to this issue! More bytes increasing of |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I sending bytes arrays from JS side to pack binary on server-side, but it doesn't seems work correctly when I trying to increase the bytes size to more than 16kb, while the same process from server side to client side - I can send bytes array 64kb without some problem
By the way, I make now an uploading process by chunks, maybe someone knows a better way)
Beta Was this translation helpful? Give feedback.
All reactions