4.1.0-java

Fix Confidence Adjustment for Larger Shingle Sizes (#407)

* Fix Confidence Adjustment for Larger Shingle Sizes

This PR addresses further adjustments to the confidence calculation issue discussed in PR 405. While PR 405 successfully resolved the issue for a shingle size of 4, it did not achieve the same results for larger shingle sizes like 8.

Key Changes
1. Refinement of seenValues Calculation:
* Previously, the formula increased confidence even as numImputed (number of imputations seen) increased because seenValues (all values seen) also increased.
* This PR fixes the issue by counting only non-imputed values as seenValues.
2. Upper Bound for numImputed:
* The numImputed is now upper bounded to the shingle size.
* The impute fraction calculation, which uses numberOfImputed * 1.0 / shingleSize, now ensures the fraction does not exceed 1.
3. Decrementing numberOfImputed:
* The numberOfImputed is decremented when there is no imputation.
* Previously, numberOfImputed remained unchanged when there is an imputation as there was both an increment and a decrement, keeping the imputation fraction constant. This PR ensures the imputation fraction accurately reflects the current state. This adjustment ensures that the forest update decision, which relies on the imputation fraction, functions correctly. The forest is updated only when the imputation fraction is below the threshold of 0.5.

Testing
* Added test scenarios with various shingle sizes to verify the changes.

Signed-off-by: Kaituo Li <[email protected]>

* added comment

Signed-off-by: Kaituo Li <[email protected]>

---------

Signed-off-by: Kaituo Li <[email protected]>

4.0.0-java

Version is 4.0 (#402)

3.8.0-java

Version is 3.8.0 (#396)

3.7.0-java

version is now 3.7 (#386)

3.6.0-java

version is 3.6.0 (#378)

* version is 3.6

* version is 3.6.0-SNAPSHOT

* lazy check argument

* fix and cleanup

* issue 381

* javadocs

3.5.1-java

fix to issue 374 (#376)

3.5.0-java

Upgrading nexus staging plugin version (#371)

* upgrading nexus staging plugin version

* updating jackson databind version

3.0.0-java

RCF Version 3.0.0 java

3.0-rc3-java

RCF Version 3.0-rc3 java

3.0-rc2.1-java

RCF Version 3.0-rc2.1 java