Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update module github.com/dgraph-io/badger/v2 to v4 #800

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update module github.com/dgraph-io/badger/v2 to v4 #800

wants to merge 1 commit into from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Feb 28, 2023 •
edited
Loading

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
github.com/dgraph-io/badger/v2 v2.2007.4 -> v4.3.0 age adoption passing confidence

Release Notes

dgraph-io/badger (github.com/dgraph-io/badger/v2)

v4.3.0: Badger v4.3.0

Compare Source

What's Changed

Fixes:

CI:

Full Changelog: dgraph-io/badger@v4.2.0...v4.3.0

v4.2.0: Badger v4.2.0

Compare Source

This release contains new and updated metrics for Badger, as well as several bug fixes.

Breaking
  • feat(metrics): fix and update metrics in badger (#​1948)
  • fix(metrics): remove badger version in the metrics name (#​1982)
Fixed
  • fix(db): avoid panic in parallel reads after closing DB (#​1987)
  • fix(logging): fix direct access to logger (#​1980)
  • fix(sec): bump google.golang.org/grpc from 1.20.1 to 1.53.0 (#​1977)
  • fix(sec): update gopkg.in/yaml.v2 package (#​1969)
  • fix(test): fix flakiness of TestPersistLFDiscardStats (#​1963)
  • fix(stream): setup oracle correctly in stream writer (#​1968) (#​1904)
  • fix(stream): improve incremental stream writer (#​1901)
  • fix(test): improve the params in BenchmarkDbGrowth (#​1967)
  • fix(sync): sync active memtable and value log on Db.Sync (#​1847) (#​1953)
  • fix(test): handle draining of closed channel, speed up test. (#​1957)
  • fix(test): fix table checksum test. Test on uncompressed. (#​1952)
  • fix(level): change split key range right key to use ts=0 (#​1932)
  • fix(test): the new test case PagebufferReader5 introduced an error. (#​1936)
  • fix(test): add missing unlock in TestPersistLFDiscardStats (#​1924)
  • fix(PageBufferReader): should conform to io.Reader interface (#​1935)
  • fix(publisher): publish updates after persistence in WAL (#​1917)
CI
  • chore(ci): split off coverage workflow (#​1944)
  • chore(ci): adding trivy scanning workflow (#​1925)

v4.1.0: Badger v4.1.0

Compare Source

This release adds support for incremental stream writer. We also do some cleanup in the docs and resolve some CI issues for community PR's. We resolve high and medium CVE's and fix #​1833.

Features
Fixes
Security
  • chore(deps): bump golang.org/x/net from 0.0.0-20201021035429-f5854403a974 to 0.7.0 (#​1885)
CVE's
Chores
  • fix(docs): update README (#​1915)
  • cleanup sstable file after tests (#​1912)
  • chore(ci): add dgraph regression tests (#​1908)
  • docs: fix the default value in docs (#​1909)
  • chore: update URL for unsupported manifest version error (#​1905)
  • docs(README): add raft-badger to projects using badger (#​1902)
  • sync the docs with README with projects using badger (#​1903)
  • fix: update code comments for WithNumCompactors (#​1900)
  • docs: add loggie to projects using badger (#​1882)
  • chore(memtable): refactor code for memtable flush (#​1866)
  • resolve coveralls issue for community PR's (#​1892, #​1894, #​1896)

Full Changelog: dgraph-io/badger@v4.0.1...v4.1.0

v4.0.1: Badger DB v4.0.1

Compare Source

This release fixes a bug in the maxHeaderSize parameter that could lead to panics. We introduce an external magic number to keep track of external dependencies. We bump up the minimum required Go version to 1.19. No changes were made to the format of data on disk. This is a major release because we are making a switch to SemVer in order to make it easier for the community to understand when breaking API and data format changes are made.

Warning
The tag v4.0.0 has been retracted due to a bug in publisher.
Use v4.0.1 (see #​1889)

Fixed
  • fix(pb): fix generated protos #​1888
  • fix(publisher): initialize the atomic variable #​1889
  • fix: update maxHeaderSize #​1877
  • feat(externalMagic): Introduce external magic number (#​1745) #​1852
  • fix(bench): bring in benchmark fixes from main #​1863
Chores
  • upgrade go to 1.19 #​1868
  • moving from CalVer to SemVer
  • chore(cd): tag based deployments #​1887
  • chore(ci): fail fast when testing #​1890
  • enable linters (gosimple, govet, lll, unused, staticcheck, errcheck, ineffassign, gofmt) #​1871 #​1870 #​1876
  • remove dependency on io/ioutil #​1879
  • various doc and comment fixes #​1857

Full Changelog: dgraph-io/badger@v3.2103.5...v4.0.1

v4.0.0

Compare Source

v3.2103.5: Badger DB v3.2103.5

Compare Source

We release Badger CLI tool binaries for amd64 and now arm64. This release does not involve any core code changes to Badger. We added a CD job for building Badger for arm64.

v3.2103.4: Badger DB v3.2103.4

Compare Source

This patches an issue that could lead to manifest corruption. Fix was merged in #​1756. Addresses this issue on Discuss and this issue on Badger. We also bring the release branch to parity with main by updating the CI/CD jobs, Readme, Codeowners, PR and issue templates, etc.

Fixed
  • fix(manifest): fix manifest corruption due to race condition in concurrent compactions (#​1756)
Chores
  • Add CI/CD jobs to release branch
  • Add PR and Issue templates to release branch
  • Update Codeowners in release branch
  • Update Readme in release branch

Full Changelog: dgraph-io/badger@v3.2103.3...v3.2103.4

v3.2103.3: BadgerDB v3.2103.3

Compare Source

This is a minor patch release that fixes arm64 related issues. The issues in the z package in Ristretto were resolved in Ristretto v0.1.1.

Fixed
  • fix(arm64): bump ristretto v0.1.0 --> v0.1.1 (#​1806)

Full Changelog: dgraph-io/badger@v3.2103.2...v3.2103.3

v3.2103.2: BadgerDB v3.2103.2

Compare Source

This patch release contains:

Fixed
  • fix(compact): close vlog after the compaction at L0 has been completed (#​1752)
  • fix(builder): put the upper limit on reallocation (#​1748)
  • deps: Bump github.com/google/flatbuffers to v1.12.1 (#​1746)
  • fix(levels): Avoid a deadlock when acquiring read locks in levels (#​1744)
  • fix(pubsub): avoid deadlock in publisher and subscriber (#​1749) (#​1751)

Full Changelog: dgraph-io/badger@v3.2103.1...v3.2103.2

v3.2103.1: BadgerDB v3.2103.1

Compare Source

This release removes CGO dependency opf badger by using Klauspost's ZSTD instead of Datadog's ZSTD. Also, this has some of the fixes.

Fixed
  • fix(compaction): copy over the file ID when building tables #​1713
  • fix: Fix conflict detection for managed DB (#​1716)
  • fix(pendingWrites): don't skip the pending entries with version=0 (#​1721)
Features
  • feat(zstd): replace datadog's zstd with Klauspost's zstd (#​1709)

v3.2103.0: BadgerDB v3.2103.0

Compare Source

Breaking
  • Subscribe: Add option to subscribe with holes in prefixes. (#​1658)
Fixed
  • fix(compaction): Remove compaction backoff mechanism (#​1686)
  • Add a name to mutexes to make them unexported (#​1678)
  • fix(merge-operator): don't read the deleted keys (#​1675)
  • fix(discard): close the discard stats file on db close (#​1672)
  • fix(iterator): fix iterator when data does not exist in read only mode (#​1670)
  • fix(badger): Do not reuse variable across badger commands (#​1624)
  • fix(dropPrefix): check properly if the key is present in a table (#​1623)
Performance
  • Opt(Stream): Optimize how we deduce key ranges for iteration (#​1687)
  • Increase value threshold from 1 KB to 1 MB (#​1664)
  • opt(DropPrefix): check if there exist some data to drop before dropping prefixes (#​1621)
Features
  • feat(options): allow special handling and checking when creating options from superflag (#​1688)
  • overwrite default Options from SuperFlag string (#​1663)
  • Support SinceTs in iterators (#​1653)
  • feat(info): Add a flag to parse and print DISCARD file (#​1662)
  • feat(vlog): making vlog threshold dynamic 6ce3b7c (#​1635)
  • feat(options): add NumGoroutines option for default Stream.numGo (#​1656)
  • feat(Trie): Working prefix match with holes (#​1654)
  • feat: add functionality to ban a prefix (#​1638)
  • feat(compaction): Support Lmax to Lmax compaction (#​1615)
New APIs
  • Badger.DB
    • BanNamespace
    • BannedNamespaces
    • Ranges
  • Badger.Options
    • FromSuperFlag
    • WithNumGoRoutines
    • WithNamespaceOffset
    • WithVLogPercentile
  • Badger.Trie
    • AddMatch
    • DeleteMatch
  • Badger.Table
    • StaleDataSize
  • Badger.Table.Builder
    • AddStaleKey
  • Badger.InitDiscardStats
Removed APIs
  • Badger.DB
    • KeySplits
  • Badger.Options
    • SkipVlog
Changed APIs
  • Badger.DB
    • Subscribe
  • Badger.Options
    • WithValueThreshold

v3.2011.1: BadgerDB v3.2011.1

Compare Source

fix(compaction): Set base level correctly after stream (#​1631) (#​1651)
fix: update ristretto and use filepath (#​1649) (#​1652)
fix(badger): Do not reuse variable across badger commands (#​1624) (#​1650)
fix(build): fix 32-bit build (#​1627) (#​1646)
fix(table): always sync SST to disk (#​1625) (#​1645)

v3.2011.0: BadgerDB v3.2011.0

Compare Source

This release is not backward compatible with Badger v2.x.x

Breaking:
  • opt(compactions): Improve compaction performance (#​1574)
  • Change how Badger handles WAL (#​1555)
  • feat(index): Use flatbuffers instead of protobuf (#​1546)
Fixed:
  • Fix(GC): Set bits correctly for moved keys (#​1619)
  • Fix(tableBuilding): reduce scope of valuePointer (#​1617)
  • Fix(compaction): fix table size estimation on compaction (#​1613)
  • Fix(OOM): Reuse pb.KVs in Stream (#​1609)
  • Fix race condition in L0StallMs variable (#​1605)
  • Fix(stream): Stop produceKVs on error (#​1604)
  • Fix(skiplist): Remove z.Buffer from skiplist (#​1600)
  • Fix(readonly): fix the file opening mode (#​1592)
  • Fix: Disable CompactL0OnClose by default (#​1586)
  • Fix(compaction): Don't drop data when split overlaps with top tables (#​1587)
  • Fix(subcompaction): Close builder before throttle.Done (#​1582)
  • Fix(table): Add onDisk size (#​1569)
  • Fix(Stream): Only send done markers if told to do so
  • Fix(value log GC): Fix a bug which caused value log files to not be GCed.
  • Fix segmentation fault when cache sizes are small. (#​1552)
  • Fix(builder): Too many small tables when compression is enabled (#​1549)
  • Fix integer overflow error when building for 386 (#​1541)
  • Fix(writeBatch): Avoid deadlock in commit callback (#​1529)
  • Fix(db): Handle nil logger (#​1534)
  • Fix(maxVersion): Use choosekey instead of KeyToList (#​1532)
  • Fix(Backup/Restore): Keep all versions (#​1462)
  • Fix(build): Fix nocgo builds. (#​1493)
  • Fix(cleanup): Avoid truncating in value.Open on error (#​1465)
  • Fix(compaction): Don't use cache for table compaction (#​1467)
  • Fix(compaction): Use separate compactors for L0, L1 (#​1466)
  • Fix(options): Do not implicitly enable cache (#​1458)
  • Fix(cleanup): Do not close cache before compaction (#​1464)
  • Fix(replay): Update head for LSM entires also (#​1456)
  • fix(levels): Cleanup builder resources on building an empty table (#​1414)
Performance
  • perf(GC): Remove move keys (#​1539)
  • Keep the cheaper parts of the index within table struct. (#​1608)
  • Opt(stream): Use z.Buffer to stream data (#​1606)
  • opt(builder): Use z.Allocator for building tables (#​1576)
  • opt(memory): Use z.Calloc for allocating KVList (#​1563)
  • opt: Small memory usage optimizations (#​1562)
  • KeySplits checks tables and memtables when number of splits is small. (#​1544)
  • perf: Reduce memory usage by better struct packing (#​1528)
  • perf(tableIterator): Don't do next on NewIterator (#​1512)
  • Improvements: Manual Memory allocation via Calloc (#​1459)
  • Various bug fixes: Break up list and run DropAll func (#​1439)
  • Add a limit to the size of the batches sent over a stream. (#​1412)
  • Commit does not panic after Finish, instead returns an error (#​1396)
  • levels: Compaction incorrectly drops some delete markers (#​1422)
  • Remove vlog file if bootstrap, syncDir or mmap fails (#​1434)
Features:
  • Use opencensus for tracing (#​1566)
  • Export functions from Key Registry (#​1561)
  • Allow sizes of block and index caches to be updated. (#​1551)
  • Add metric for number of tables being compacted (#​1554)
  • feat(info): Show index and bloom filter size (#​1543)
  • feat(db): Add db.MaxVersion API (#​1526)
  • Expose DB options in Badger. (#​1521)
  • Feature: Add a Calloc based Buffer (#​1471)
  • Add command to stream contents of DB into another DB. (#​1463)
  • Expose NumAlloc metrics via expvar (#​1470)
  • Support fully disabling the bloom filter (#​1319)
  • Add --enc-key flag in badger info tool (#​1441)
New APIs
Removed APIs

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch 2 times, most recently from 91235db to 90e0d41 Compare March 6, 2023 07:50
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch 2 times, most recently from ce9faed to 6c8d63a Compare March 15, 2023 17:07
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch 2 times, most recently from e912fbf to 0b6faf4 Compare March 23, 2023 22:06
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 0b6faf4 to 31333f8 Compare April 4, 2023 22:11
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch 4 times, most recently from c18843c to b4155f2 Compare April 20, 2023 09:51
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch 3 times, most recently from ae6d7e8 to 9b0ceef Compare May 4, 2023 12:49
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 9b0ceef to eae70f8 Compare May 8, 2023 16:08
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from eae70f8 to f01fdaa Compare May 28, 2023 05:58
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from f01fdaa to 67cb85a Compare July 9, 2023 10:33
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 67cb85a to 42973ba Compare August 4, 2023 13:51
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 42973ba to a17fa41 Compare August 22, 2023 16:16
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from a17fa41 to 7cb5d3d Compare September 19, 2023 10:45
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 7cb5d3d to 94d564e Compare September 26, 2023 12:20
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 94d564e to 5ee85f6 Compare October 12, 2023 18:38
@renovate renovate bot changed the title Update module github.com/dgraph-io/badger/v2 to v4 Update module github.com/dgraph-io/badger/v2 to v4 - autoclosed Oct 23, 2023
@renovate renovate bot closed this Oct 23, 2023
@renovate renovate bot deleted the renovate/github.com-dgraph-io-badger-v2-4.x branch October 23, 2023 09:07
@renovate renovate bot changed the title Update module github.com/dgraph-io/badger/v2 to v4 - autoclosed Update module github.com/dgraph-io/badger/v2 to v4 Oct 23, 2023
@renovate renovate bot reopened this Oct 23, 2023
@renovate renovate bot restored the renovate/github.com-dgraph-io-badger-v2-4.x branch October 23, 2023 15:15
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 5ee85f6 to e9eb098 Compare October 23, 2023 15:15
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from e9eb098 to 423723f Compare November 16, 2023 13:19
@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 423723f to 83d26df Compare January 28, 2024 12:00
@renovate Renovate
Copy link
Contributor Author

renovate bot commented Jun 4, 2024 •
edited
Loading

ℹ Artifact update notice

File name: go.mod

In order to perform the update(s) described in the table above, Renovate ran the go get command, which resulted in the following additional change(s):

  • 12 additional dependencies were updated

Details:

Package Change
golang.org/x/sync v0.5.0 -> v0.8.0
github.com/cespare/xxhash/v2 v2.2.0 -> v2.3.0
github.com/dgraph-io/ristretto v0.0.3-0.20200630154024-f66de99634de -> v0.1.2-0.20240116140435-c67e07994f91
github.com/dgryski/go-farm v0.0.0-20190423205320-6a90982ecee2 -> v0.0.0-20200201041132-a6ae2369ad13
github.com/dustin/go-humanize v1.0.0 -> v1.0.1
github.com/golang/protobuf v1.5.3 -> v1.5.4
github.com/klauspost/compress v1.12.3 -> v1.17.9
golang.org/x/crypto v0.14.0 -> v0.26.0
golang.org/x/net v0.17.0 -> v0.28.0
golang.org/x/sys v0.13.0 -> v0.24.0
golang.org/x/text v0.13.0 -> v0.17.0
google.golang.org/protobuf v1.31.0 -> v1.33.0

@renovate renovate bot force-pushed the renovate/github.com-dgraph-io-badger-v2-4.x branch from 83d26df to 4800edf Compare August 28, 2024 14:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
0 participants