Epic: Execution Planner

[cscheid]

In our TypeScript codebase, we need a source of truth for which input files produce which output files (and which temporaries).

Potential wins once we have this:

• parallelization
• change output locations (including slugs, etc)
• safer parameterized reports
• avoid file overwriting

Issues:

• The --output trigger overwrites previously rendered file #6472
• Quarto deletes the original index.ipynb file when rendering a different notebook (index.render.ipynb) with output-file: index, despite the original file being explicitly ignored in the project configuration. #10841
• Race condition when running multiple instances of quarto #6116
• Parallel Computing - using one .qmd to render n output files - cannot open the connection #5861
• Parallel creation of parameterized reports fails due to file conflicts #4730
• [VSCode] Rendering Deletes ipynb File #4802
• improvement: make --output option generate directories which respect the option #690
• quarto inspect and temporary directories #906
• Long render times #1152
• TeX file is not moved to output-dir #1294
• [Feature request] Can Quarto please create_all_ temporary files _not_ in the same directory with my source files? #1666
• Quarto should output websites with "pretty" URLs #2065
• communicate format output to all engines  #2216
• output-file parameter follows file location, not project (_quarto.yml) location. #2375
• Render to a new file name stores resources in directory with name of qmd file #2363
• Getting file not found errror when setting revealjs setting #6809
• Rename tex output to output-file when keep-tex: true #6045
• output file name conflict when two formats targets same extension (like html and revealjs) #4583
• Quarto render / preview immediately reports "SyntaxError: Unexpected end of JSON input" #6392
• Multiple pdf format fail with generated figures #8367
• Supporting file are cleanup to soon when using multiformat #8373

Notes

Lockfiles

When fixing #6472, we should consider a design for lockfiles, so that different instances of running quarto (which happens often when running a VS code preview and a command-line render, like in our test suite) don't step on each other's toes.

• .quarto directory should have quarto's version information in it to remove stale crossref index and prevent unexplicit errors #8626 (.quarto should be versioned)

• Lockfile for preview #4632

Other things to do

• when doing notebook embedding, we currently do a lot of this kind of "file exists" reasoning. That should be a part of this planner instead.
• this is also involved in getting multiple versions of a same page to be rendered (dark + light, mobile + desktop, etc)

[mcanouil]

Discussions that would be addressed by this epic (Maybe worth opening explicitly an issue out of them)

• Only render changed files #3674
• Output directory in quarto-cli #2171
• List files and directories created/updated by `quarto render` #2372
• Control order of rendering #6944 (Can't control the render order on GitHub Actions ubuntu-latest #10463)

Slightly related:

• Speed up loading and rendering time #5273

---

• Preview not updated on changes to included files #2795
• Changes in included files don't trigger re-execution when freeze: auto is set #6793
• be mindful of case sensitivity in project outputs (was: Website with LICENSE.md and license.qmd fails to render) #6848
• Feature request: For quarto book qmd files, allow execution order to differ from order appearing in book #3568

---

PS: don't hide, simply edit/remove^^