Limit the parameters to what the Manifest generation process needs

[taniyourstruly]

Component(s)

collector

Is your feature request related to a problem? Please describe.

From #2399, many objects are passed to the builder via the Params struct and we don't want any unnecessary feedback being given by the validation webhook. We should restrict the params to what the manifest generation process actually needs by only passing those params to the builders.

Describe the solution you'd like

Limit the amount of parameters we pass to the builders.

Describe alternatives you've considered

No response

Additional context

No response