Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backup: File size (2198076580) is greater than 2 GiB #275

Closed
abdulrahman1s opened this issue Jul 25, 2024 · 3 comments
Closed

Backup: File size (2198076580) is greater than 2 GiB #275

abdulrahman1s opened this issue Jul 25, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@abdulrahman1s
Copy link

To Reproduce

  1. Set up a PostgreSQL database with data exceeding 2 GiB.
  2. Configure the backup functionality to use Cloudflare R2 as the provider.
  3. Initiate the backup process.
  4. Observe the error message indicating the file size exceeds 2 GiB.

Current vs. Expected behavior

The PostgreSQL database backup functionality fails when dealing with large databases. Specifically, an error message is displayed stating: "File size (2198076580) is greater than 2 GiB."

Provide environment information

OS: Ubuntu 24.04 LTS x86_6 
Dokploy version: v0.4.0
VPS Provider: OVH

Which area(s) are affected? (Select all that apply)

Databases

Additional context

No response

@abdulrahman1s abdulrahman1s added the bug Something isn't working label Jul 25, 2024
@Siumauricio
Copy link
Contributor

Thank you for reporting this issue, I will try to fix this weekend!

@saidul
Copy link

saidul commented Sep 13, 2024

This could be related to either reading the whole file into memory or using PutObjectCommand in

const fileContent = await readFile(filePath);
const command = new PutObjectCommand({
Bucket: bucket,
Key: destinationBucketPath,
Body: fileContent,
});
await s3Client.send(command);

Using multipart upload may solve this issue.

Also using rclone (discussed in #416 ) will also solve this issue.

@Siumauricio
Copy link
Contributor

Closed in #469

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants