Release 5.0.0rc2 (2024-06-26)

Known Issues

⚠️ This release is not ready for production usage. ⚠️

• ClamAV not configured
• Unstable container service IP addresses
• Lacking Nvidia utils

What's Changed

• Use pip-compile for package resolution by @jemrobinson in #1514
• Add pip-tools to NON_IMPORTABLE_PACKAGES by @edwardchalstrey1 in #1537
• Add May 2023 DSG to versioning by @jemrobinson in #1545
• Release v4.1.0 cloud init changes by @edwardchalstrey1 in #1548
• Update SRD package versions by @github-actions in #1578
• Update PyPI and CRAN allow lists by @github-actions in #1579
• Fix deployment issues with MSSQL and PyPi mirrors by @craddm in #1582
• Update PyPI and CRAN allow lists by @github-actions in #1588
• Update SRD package versions by @github-actions in #1587
• Updates for Release v4.1.0 by @craddm in #1590
• Release v4.1.0 by @craddm in #1586
• Remove CoCalc by @craddm in #1554
• Merge 'latest' into 'develop' by @craddm in #1593
• Add script to automate account deletion by @edwardchalstrey1 in #1508
• Add @craddm to CODEOWNERS by @jemrobinson in #1594
• Update PyPI and CRAN allow lists by @github-actions in #1595
• Remove pulumi testing files from develop branch by @craddm in #1597
• Update PyPI and CRAN allow lists by @github-actions in #1601
• Update SRD package versions by @github-actions in #1616
• Update SRD package versions by @github-actions in #1622
• Bump urllib3 from 2.0.2 to 2.0.6 in /docs by @dependabot in #1625
• Improve Pulumi error messages by @craddm in #1624
• Update PyPI and CRAN allow lists by @github-actions in #1627
• Update PyPI and CRAN allow lists by @github-actions in #1631
• Update SRD package versions by @github-actions in #1630
• Improve Python documentation by @jemrobinson in #1635
• Use Pulumi random provider by @jemrobinson in #1629
• Pulumi: Fix selectors not updating by @JimMadge in #1621
• Bump urllib3 from 2.0.6 to 2.0.7 in /docs by @dependabot in #1647
• Remove hyphens from SHM and SRE names by @craddm in #1650
• Update PyPI and CRAN allow lists by @github-actions in #1646
• Update SRD package versions by @github-actions in #1652
• Pulumi: Improve login flow by @JimMadge in #1617
• Update PyPI and CRAN allow lists by @github-actions in #1654
• Add all contributors table and instructions for how to update by @edwardchalstrey1 in #1649
• Update PyPI and CRAN allow lists by @github-actions in #1656
• Update PyPI and CRAN allow lists by @github-actions in #1668
• Update SRD package versions by @github-actions in #1669
• Update devcontainer configuration by @craddm in #1662
• Update outdated parameters that cause breaking change warnings by @craddm in #1663
• Change default lun from lun1 to lun0 by @craddm in #1667
• Add context command by @JimMadge in #1655
• Pulumi: Update dependencies, enable pinning by @JimMadge in #1660
• Remove unneeded opening bracket in SRE network configuration script by @craddm in #1670
• Update PyPI and CRAN allow lists by @github-actions in #1671
• Use memory for the /tmp directory by @craddm in #1672
• Factor out storage creation from SHM scripts by @craddm in #1673
• Add missing import for logging module by @JimMadge in #1681
• Update PyPI and CRAN allow lists by @github-actions in #1682
• Update help text for Powershell command shmId andsreId arguments by @craddm in #1683
• Update contributors by @JimMadge in #1684
• Document removal of persistent SRE storage accounts by @craddm in #1685
• docs: update @helendduncan as a contributor by @JimMadge in #1686
• Update PyPI and CRAN allow lists by @github-actions in #1688
• Update SRD package versions by @github-actions in #1692
• Update PyPI and CRAN allow lists by @github-actions in #1693
• Update PyPI and CRAN allow lists by @github-actions in #1694
• Update DBeaver drivers using Github workflow by @craddm in #1696
• Update SRD package versions by @github-actions in #1698
• Bump jinja2 from 3.1.2 to 3.1.3 in /docs by @dependabot in #1700
• Update SRD package versions by @github-actions in #1701
• Update PyPI and CRAN allow lists by @github-actions in #1702
• Update PyPI and CRAN allow lists by @github-actions in #1703
• Handle no selected context by @JimMadge in #1691
• Add basic config commands by @JimMadge in #1674
• Fixing DBeaver driver issues on T2+ SREs by @craddm in #1704
• Use Pydantic for validation and serialisation by @JimMadge in #1661
• Improve handling of spaces in file paths by @craddm in #1705
• Update PyPI and CRAN allow lists by @github-actions in #1706
• Create pulumi container by @jemrobinson in #1711
• Fix private link scope by @jemrobinson in #1713
• Improve handling of SRE names by @JimMadge in #1699
• Apply changes from updated black version by @jemrobinson in #1718
• Bump black version by @JimMadge in #1719
• Fix some issues with context handling at deployment time by @jemrobinson in #1716
• Update SRD package versions by @github-actions in #1723
• Correct file path for clamonacc service by @craddm in #1725
• Add additional multiple data provider guidance to docs by @craddm in #1707
• Update SRD package versions by @github-actions in #1727
• Fix PostgreSQL permissions and data schema, and relevant docs by @craddm in #1708
• Update to Ruff v0.2 by @jemrobinson in #1731
• Minor DSC fixes by @jemrobinson in #1729
• Update SRD package versions by @github-actions in #1728
• Drop deprecated NetworkProfile option for ContainerGroups by @jemrobinson in #1734
• Increase apt proxy server disk to 64 Gb by @craddm in #1726
• Upgrade to PostgreSQL flexible server by @jemrobinson in #1735
• Use built-in Pulumi bcrypt by @jemrobinson in #1740
• Remove omsagent from build image by @craddm in #1732
• Add links to guides for terminal, Xfce, and Guacamole by @craddm in #1737
• Update software on guacamole server by @craddm in #1741
• Update PyPI and CRAN allow lists by @github-actions in #1742
• Update Nexus proxy server for T2/T3 package access by @craddm in #1744
• Update CodiMD server version by @craddm in #1743
• Update SRD package versions by @github-actions in #1746
• Install dev dependencies in container by @JimMadge in #1747
• Update PyPI and CRAN allow lists by @github-actions in #1748
• Add guidance on resizing NFS shares by @JimMadge in #1749
• Update documents to reflect change to Microsoft Entra ID by @craddm in #1665
• Improve hardcoded domains and IP addresses by @JimMadge in #1745
• Add script to renew NFS share Stored Access Policies by @JimMadge in #1739
• Update SRD package versions by @github-actions in #1750
• Update SRD package versions by @github-actions in #1758
• Update PyPI and CRAN allow lists by @github-actions in #1760
• Add Roadmap by @JimMadge in #1757
• Update PyPI and CRAN allow lists by @github-actions in #1761
• Updates from pen test by @JimMadge in #1763
• Restructure processes section of docs by @JimMadge in #1766
• Release v4.2.0 by @JimMadge in #1754
• Merge v4.2.0 into develop by @JimMadge in #1767
• Update PyPI and CRAN allow lists by @github-actions in #1769
• Merge develop into python-migration by @jemrobinson in #1768
• Minor Pulumi deployment fixes by @jemrobinson in #1765
• Update PyPI and CRAN allow lists by @github-actions in #1770
• Migrate deployment code to Python/Pulumi by @jemrobinson in #1773
• Bump cryptography from 41.0.7 to 42.0.4 by @dependabot in #1774
• Fix Docker versions script by @jemrobinson in #1775
• Remove pwsh by @JimMadge in #1752
• Remove remaining pwsh things by @JimMadge in #1779
• Bump idna from 3.4 to 3.7 in /docs by @dependabot in #1785
• Bump idna from 3.6 to 3.7 by @dependabot in #1786
• Add AzureAD/EntraID functionality by @jemrobinson in #1778
• Add dependabot configuration by @JimMadge in #1787
• Update firewall rules to parity with 4.2.0 by @craddm in #1781
• Change AllowExternalAzureAutomationOperations to a network rule by @jemrobinson in #1804
• Bump actions/setup-python from 4 to 5 by @dependabot in #1798
• Bump peter-evans/create-pull-request from 4.2.4 to 6.0.3 by @dependabot in #1796
• Bump actions/cache from 3 to 4 by @dependabot in #1793
• Bump lycheeverse/lychee-action from 1.7.0 to 1.9.3 by @dependabot in #1791
• Update docs by @JimMadge in #1806
• Bump myst-parser from 1.0.0 to 2.0.0 in /docs by @dependabot in #1800
• Update dependabot config by @JimMadge in #1803
• Bump karancode/yamllint-github-action from 2.0.0 to 2.1.1 by @dependabot in #1790
• Bump actions/checkout from 2 to 4 by @dependabot in #1808
• Correct Python version by @JimMadge in #1811
• Add UniqueList annotated type by @JimMadge in #1815
• Use Apricot for authentication/identity by @jemrobinson in #1772
• Fix Docker image updater action by @jemrobinson in #1822
• Update Pulumi Docker images by @github-actions in #1825
• Remove SHM DC by @jemrobinson in #1805
• Add local DNS for SRE identity server by @jemrobinson in #1821
• Create Enum for ports by @JimMadge in #1819
• Bump peter-evans/create-pull-request from 6.0.3 to 6.0.4 by @dependabot in #1829
• Fix dependabot by @jemrobinson in #1827
• Update Python dependencies by @github-actions in #1831
• Update Dockerfile and devcontainer for pulumi/python by @craddm in #1834
• Update Python dependencies by @github-actions in #1842
• ⬆️ Bump lycheeverse/lychee-action from 1.9.3 to 1.10.0 by @dependabot in #1843
• ⬆️ Bump peter-evans/create-pull-request from 6.0.4 to 6.0.5 by @dependabot in #1844
• Run tests and linting on all PRs by @JimMadge in #1845
• Separate config classes by @jemrobinson in #1840
• Pulumi storage fixes, including adding encryption key by @craddm in #1839
• Move pulumi context settings and persistent data by @JimMadge in #1820
• File structuring by @jemrobinson in #1848
• Break circular dependency in Context by @jemrobinson in #1853
• Move update servers to SRE by @jemrobinson in #1847
• Update Python dependencies by @github-actions in #1861
• Add warning messages to automatic PRs by @jemrobinson in #1863
• Simplify SREProvisioningManager by @jemrobinson in #1858
• Remove unused SHM data component by @jemrobinson in #1860
• Add test for help function by @jemrobinson in #1855
• Fix identity server deployment by @jemrobinson in #1865
• Basic deployment docs by @jemrobinson in #1867
• Lint caddyfiles by @jemrobinson in #1856
• Use Entra ID throughout by @jemrobinson in #1869
• Move encrypted_key to DSHPulumiConfig by @JimMadge in #1854
• Add option to run tests with code coverage by @craddm in #1866
• Run coverage on PRs from forks by @jemrobinson in #1875
• Update coverage workflow trigger by @jemrobinson in #1876
• Use workflow structure suggested by py-cov-action by @jemrobinson in #1877
• Restructure commands by @JimMadge in #1870
• Remove unused components by @jemrobinson in #1874
• Update docs for commands restructure by @JimMadge in #1880
• ⬆️ Update Python dependencies by @github-actions in #1884
• Fix inconsistent firewall rules by @jemrobinson in #1883
• Protect against configuration changes by @JimMadge in #1881
• Update GitHub templates by @jemrobinson in #1887
• Move SHM firewall to SRE by @jemrobinson in #1872
• Regular maintenance updates for Linux VMs by @craddm in #1885
• Arbitrary pulumi commands by @JimMadge in #1888
• Update labels in GitHub templates by @jemrobinson in #1901
• ⬆️ Update Python dependencies by @github-actions in #1906
• Don't generate coverage for tests by @JimMadge in #1907
• Add pulumi tests by @jemrobinson in #1894
• ⬆️ Bump requests from 2.31.0 to 2.32.0 in /docs by @dependabot in #1910
• ⬆️ Bump requests from 2.31.0 to 2.32.0 by @dependabot in #1912
• Remove Azure Automation from SHM by @jemrobinson in #1911
• Enable Azure api tests by @JimMadge in #1913
• Fix next_occurrence function by @jemrobinson in #1893
• ⬆️ Update Python dependencies by @github-actions in #1918
• Suppress warnings in config template by @JimMadge in #1920
• Validate SHM/SRE for user commands by @JimMadge in #1921
• Clarify context add subscription argument by @JimMadge in #1919
• Release v4.2.1 by @jemrobinson in #1915
• ⬆️ Update Python dependencies by @github-actions in #1925
• Merge v4.2.1 changes into develop by @jemrobinson in #1924
• Add action to update RTD docs by @JimMadge in #1927
• ⬆️ Update Pulumi Docker images by @github-actions in #1929
• Add more informative error messages to context commands by @craddm in #1916
• Move log analytics to SRE by @jemrobinson in #1928
• ⬆️ Update Python dependencies by @github-actions in #1934
• ⬆️ Update Pulumi Docker images by @github-actions in #1933
• Bump azure-identity from 1.16.0 to 1.16.1 by @dependabot in #1935
• Remove SRE index by @jemrobinson in #1930
• ⬆️ Update Python dependencies by @github-actions in #1937
• docs: add @J0shev as a contributor by @JimMadge in #1941
• Logging by @JimMadge in #1936
• Remove broken link to git cheat sheet by @JimMadge in #1949
• Reduce number of files opened during testing by @jemrobinson in #1951
• ⬆️ Bump urllib3 from 2.2.1 to 2.2.2 by @dependabot in #1940
• Separate SHM and SRE configs by @jemrobinson in #1943
• Add console module by @JimMadge in #1948
• ⬆️ Bump peter-evans/create-pull-request from 6.0.5 to 6.1.0 by @dependabot in #1959
• ⬆️ Update Python dependencies by @github-actions in #1958
• Correct test file name by @JimMadge in #1960
• Adjust Pulumi message logging by @JimMadge in #1957
• Fix for multiline errors when writing to log files by @jemrobinson in #1953
• Change package version specifiers to be lower limits by @jemrobinson in #1964
• docs: add @dsj976 as a contributor by @JimMadge in #1968
• Add comments/docstrings to exceptions by @craddm in #1873
• Merge SHM and context resource deployment by @jemrobinson in #1963
• Remove unused code by @jemrobinson in #1970
• Update Ubuntu VM images by @craddm in #1909
• Fix EntraApplication resource issues by @jemrobinson in #1975
• Add new priority for workspace denied by @JimMadge in #1974
• ⬆️ Update Python dependencies by @github-actions in #1979
• Fix rogue highlighting by @jemrobinson in #1985
• Fix certificate teardown failure by @jemrobinson in #1983
• Add 'force' option to SRE teardown by @jemrobinson in #1982
• Stop deployment from non-approved IP addresses by @jemrobinson in #1977
• Add abc decorators to DshResourceProvider by @jemrobinson in #1981
• ⬆️ Update Pulumi Docker images by @github-actions in #1990
• Fix tests with IP check by @JimMadge in #1992
• ⬆️ Update Python dependencies by @github-actions in #1991
• Ensure that Entra applications get deleted at teardown by @jemrobinson in #2003
• Update project roadmap by @JimMadge in #2005
• Use DockerHub credentials by @jemrobinson in #2007
• Refactor Azure authentication classes by @jemrobinson in #2002
• ⬆️ Update Python dependencies by @github-actions in #2013
• ⬆️ Update Pulumi Docker images by @github-actions in #2012
• Ensure that Pulumi encryption key is created during SHM deployment by @jemrobinson in #2011
• Clean Pulumi state during cleanup by @jemrobinson in #2009
• Fix AzureSdk call by @jemrobinson in #2015
• Merge v4.2.2 changes into develop by @jemrobinson in #2016
• Add location specifiers to network resources by @jemrobinson in #2023
• SRE deployment fixes by @jemrobinson in #2026
• Exclude doi.org from lychee link check by @JimMadge in #2030
• ⬆️ Update Python dependencies by @github-actions in #2029
• Allow unencrypted storage for Azure credential tokens by @craddm in #2032
• User register docs by @JimMadge in #2031
• Better logging during SRE provisioning by @jemrobinson in #2033
• Stop unnecessary resource recreation by @jemrobinson in #2034
• Add workspace packages by @JimMadge in #1892
• Suppress logging from AzureSdk and GraphApi in Pulumi dynamic components by @jemrobinson in #2018
• Purge Key Vault during SRE teardown by @jemrobinson in #2017
• Use a single resource group for all SRE resources by @jemrobinson in #2014
• Add polkit rule to allow colord by @JimMadge in #2048
• Fix Ansible lint warning by @JimMadge in #2047
• Add auditd configuration by @JimMadge in #2024
• Fix construction of apt package lists by @JimMadge in #2052
• Add Entra documentation by @jemrobinson in #2039
• Fix smoke tests by @JimMadge in #2050

Full Changelog: v5.0.0-rc.1...v5.0.0-rc2