Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setup TeamCity caching #2126

Open
evetion opened this issue Mar 3, 2025 · 2 comments
Open

Setup TeamCity caching #2126

evetion opened this issue Mar 3, 2025 · 2 comments
Labels
CI/CD Continuous Integration/Continuous deployment

Comments

@evetion
Copy link
Member

evetion commented Mar 3, 2025

Currently both the .pixi and .julia folders are created/touched/updated by our builds on any of the agents we run on. Given multiple agents, we precompile on some, and not so much on others. Agentes are reset after a month.

It would be good to fix this and streamline this process by using caching, as we do for Github Actions. Teamcity has a build feature for caching, and I've implemented it: https://github.com/Deltares/Ribasim/blob/main/.teamcity/Templates/GenerateCache.kt#L23-L24. However, the current cache of .pixi and .julia is much larger than the allowed 3GB artefact limit.

TODO:

  • Limit size of artefacts (choose, or split caching actions between pixi/julia)
  • Instead of making use of ~/.julia, or ~/.pixi, generate/use a cache from a local location that is cleaned up afterwards.
@github-project-automation github-project-automation bot moved this to To do in Ribasim Mar 3, 2025
@evetion evetion added the CI/CD Continuous Integration/Continuous deployment label Mar 3, 2025
@evetion
Copy link
Member Author

evetion commented Mar 4, 2025

The pixi cache is too big (9GB with Julia, only 3 is allowed). I've set the Julia cache based on DEPOT_PATH, but it doesn't seem to matter much yet...

@evetion
Copy link
Member Author

evetion commented Mar 17, 2025

Note that the above is thus live on TC.

@visr visr changed the title Setup TC caching Setup TeamCity caching Mar 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI/CD Continuous Integration/Continuous deployment
Projects
Status: To do
Development

No branches or pull requests

1 participant