Tarball directory structure to mirror NPM registry

[deskoh]

Is it possible to allow the tarballs download directory structure to mirror npm registry? Specifically the .tgz would be in a - directory (e.g. node-tgz-downloader/-/node-tgz-downloader-3.11.2-preview1.tgz)?

The intent is for mirroring npm packages into AirGap environment, something like package-bundle, however package-bundle does not allow you to download packages according to package-lock.json file.

[Meir017]

@deskoh is your goal to serve the tgz files using a simple static server?
I first started this project to work together with https://github.com/verdaccio/verdaccio

[deskoh]

Oh yes! I'm currently using verdaccio in an airgap environment currently as a portable registry to proxy to another internal airgap Artifactory. It certainly brought about much convenience! (It's portable cos we might need to move to a different site)

The intent is to allow developers to self-service to bring in packages. package-bundle works great to bring in packages for Artifactory but when we need specific versions in package-lock.json, that workflow doesn't work anymore.

Any advice?

[deskoh]

To add on, verdaccio also requires '-' in the directory structure. Other than the lack of CLI, to import into Artifactory would mean that I need some scripts to move each tgz file into - directory.

[Meir017]

@deskoh all you need to do is iterate over all of the downloaded .tgz files and npm publish then to your verdaccio server
it will keep the original shasum and all of the original values.

you might need to enable the https://docs.npmjs.com/cli/v7/using-npm/config#ignore-scripts flag

[Meir017]

@deskoh some packages might need special handling, for example the node-sass module tries to download artifacts from github releases.
I created https://github.com/meir017/node-sass-downloader/ to help with that

[deskoh]

@deskoh all you need to do is iterate over all of the downloaded .tgz files and npm publish then to your verdaccio server
it will keep the original shasum and all of the original values.

you might need to enable the https://docs.npmjs.com/cli/v7/using-npm/config#ignore-scripts flag

Learnt something new. Currently package-bundle outputs a single tgz file for potentially 100's of packages that our developers can just drag and drop in Artifactory UI to upload.
Trying my luck to strive for a workflow with better developer experience for my fellow devs =)

[deskoh]

@deskoh some packages might need special handling, for example the node-sass module tries to download artifacts from github releases.
I created https://github.com/meir017/node-sass-downloader/ to help with that

Awesome. This would be useful too! Currently we are downloading it manually based on arch and version required to manually mirror them. Other packages we encountered with such requirements are electron, cypress...