Skip to content

Releases: thoth-station/thoth-application

Release v2023.01.23

24 Jan 04:53
@harshad16 harshad16
v2023.01.24
7f68074
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2023.01.23 Latest
Latest

we have completed the release for v2023.01.23 🎉 🎊 🥳
With the start of 2023, the team focused on fixing bugs in this sprint.

Fixes

Fix congestion in data ingestion due to kafka consumer
one kafka consumer in the investigator was being used to handle all kafka topics. However as our data ingestion is growing date-to-date, it was causing congestion for the consumer. With the split of topic-based on data ingestion and data services between different consumers per namespace, the issue is now handled.

Solvers failure due to unique constraint violation
Some of the solver workflow runs were failing due to unique constraint violations. The issue was being caused by unique constraints and an update of the table with new data. with the fix of the update function and fixing the SQL table configuration, this is resolved.

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

  • Fix the amun-api deployment with web concurrency set by @harshad16 in #2701
  • upgrade kebechet for the release fix by @harshad16 in #2706
  • 📉 Setup monitoring for stage systems by @harshad16 in #2703
  • 📦 Use the new monitoring deployment in thoth-station component by @harshad16 in #2705
  • Fix imagestream issue for workflow-helper by @harshad16 in #2708
  • Upgrade kebechet image version to v1.11.2 by @harshad16 in #2709
  • Upgrade workflow helper image version to v0.9.15 by @harshad16 in #2710
  • make callback secret optional by @KPostOffice in #2702
  • Disable pulp index sync job for temporary fix by @harshad16 in #2712
  • Upgrade management-api in prod to get storage v0.73.6 changes by @harshad16 in #2713
  • Upgrade management-api in prod to get storage v0.73.6 changes by @harshad16 in #2714
  • 🚢 Bump up version of the updated component in release v2022.12.05 by @harshad16 in #2715
  • 🚢 Release of version 2022.12.05 by @harshad16 in #2717
  • 🔒 Update the certs for the stage and test URLs by @harshad16 in #2719
  • ⏸️ Pause the graph-refresh job for sync period to stabilize by @harshad16 in #2721
  • Suspend prescription refresh execution by @codificat in #2722
  • 😶‍🌫️ Updating the kafka certs for smaug cluster deployment by @harshad16 in #2723
  • 📌 Upgrade the graph-sync and solver in stage cluster by @harshad16 in #2726
  • 📌 Upgrade the management-api in stage cluster by @harshad16 in #2728
  • 📌 Upgrade the metrics-exporter in stage cluster by @harshad16 in #2729
  • 📌 Upgrade the all components using thoth-storages in stage cluster by @harshad16 in #2730
  • ⏯️ Resume graph-refresh-job for data ingestion by @harshad16 in #2731
  • 😶‍🌫️ Remove unused env var in graph-sync job by @harshad16 in #2727
  • 📌 Upgrade user-api in stage cluster for cachemiss error fix by @harshad16 in #2732
  • temporarily disable message sending after adviser is complete by @KPostOffice in #2733
  • 🔗 Split the investigator consumer based on namespace by @harshad16 in #2734
  • 🚢 Bump up version of the updated component in release v2023.01.23 by @harshad16 in #2736
  • Release of version 2023.01.24 by @khebhut in #2738

Full Changelog: v2022.11.14...v2023.01.24

Contributors

codificat, harshad16, and KPostOffice
Assets 2
Loading

Release v2022.12.05

05 Dec 09:47
@harshad16 harshad16
v2022.12.05
5518296
This commit was signed with the committer’s verified signature.
harshad16 Harshad Reddy Nalla
GPG key ID: 262A80E41BCEEBF7
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.12.05

we have completed the release for v2022.12.05 🎉 🎊 🥳

Features

Enable Kebechet's version manager to maintain the version on pyproject.toml
Many poetry-based repositories have started to use package version definitions on the pyproject.toml.
We have enabled the kebechet version manager to help users maintain version on pyproject.toml.

Fixed Kebechet issuing PR description dependent on issue description
Earlier kebechet was creating Pull request descriptions dependent to issue description, with the current
fix the PR description is made independent of the issue description.

Enable pipfile_requirements manager to support editable installs
The pipfile_requirements manager was failing to identify the version of the package, used to report this as a problem by creating an issue, and does not complete the generation of requirements.txt. We have fixed this in the new version
of kebechet and now it supports editable installs with pipfile_requirements manager.

In-House Changes

We have moved our in-house monitoring system to a new cluster.
Our members having VPN access can use these services.

Prometheus: Links
Pushgateway: Links
Grafana: Links

Issue: #2455

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

Full Changelog: v2022.11.14...v2022.12.05

Contributors

harshad16 and KPostOffice
Assets 2
Loading

Release v2022.11.14

14 Nov 21:59
@harshad16 harshad16
v2022.11.14
a0e2998
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.11.14

we have completed the release for v2022.11.14 🎉 🎊 🥳

Features

Option to configure different managers per overlay

A .thoth.yaml configuration file supports overlays, which allows e.g. different configurations for thoth adviser (different runtimes, different recommendation types). However, the manager's configuration section is common to all the overlays.
The ability to have different Kebechet manager configurations in different overlays, so users can choose to get the benefits of thoth advice in one overlay but just use the pipenv-based update manager for another is now available in kebechet.

Kebechet now signs-off commits

Kebechet (Dependency Update bot) now signs off commits to pass the DCO verification CI checks.

Allow local and git package references in the update manager

Kebechet's new release would function without restricting users from having git reference or local package reference in python package management files and would provide dependency updates for the packages.

New Contributors

Thanks to our new contributors 💯

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

Full Changelog: v2022.10.24...v2022.11.14

Contributors

codificat, harshad16, and 4 other contributors
Assets 2
Loading

Release v2022.10.24

24 Oct 18:24
@harshad16 harshad16
v2022.10.24
a13add7
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.10.24

we have completed the release for v2022.10.24 🎉 🎊 🥳

Features

Thamos filter for clustering justifications

Demo: https://youtu.be/8lBCTJGRgKE
Thamos now has two new functionalities that help the user better scrub through the long list of justifications and stack info. You can now ask Thamos to list the clusters of justifications found in an advise run. And you can also apply filters to the results of an advise run based min these clusters.

Include Callback URL to Thoth Advise

Demo: https://youtu.be/A_hCwV78H_A
Our current implementation of Kebechet relies on the adviser workflow to run Kebechet certain data is provided to the user-api. This creates a very tight coupling between the two services. User API should accept instead a callback URL as this allows for a more generic integration point.

Upgraded Document Sync Job

The document generated as a part of data ingestion is synced into our stable service, via a document sync job.
The service is rewritten to use the boto3 package and storage packages to avoid overwriting and missing the documents.

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

New Contributors

Full Changelog: v2022.10.03...v2022.10.24

Contributors

Gkrumbach07, harshad16, and 2 other contributors
Assets 2
Loading

Release v2022.10.03

03 Oct 21:17
@harshad16 harshad16
v2022.10.03
c6d75c0
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.10.03

we have completed the release for v2022.10.03 🎉 🎊 🥳

Features

new thamos diff command

Thamos has a new feature where you can see the difference between your adviser runs. This command can be run in a few different ways, so check out the video demo or read up on the feature in its GitHub issue: thamos

Fix Kebechet Advise working on all overlays

Kebechet Advise works on providing the thoth advice for python package stack, there was an issue where, when using overlays kebechet was not able to update them properly, thoth-station/kebechet#1113.
we worked on fixing that issue. thoth-station/kebechet#1118

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

Full Changelog: v2022.09.14...v2022.10.03

Contributors

harshad16
Assets 2
Loading

Release v2022.09.12

14 Sep 15:42
@harshad16 harshad16
v2022.09.14
c98d0a8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.09.12

we have completed the release for v2022.09.12 🎉 🎊 🥳

Features

Custom Notebook Image operator: build and import from GitHub - https://youtu.be/GgWfsKd6I1M
The Meteor Operator is being adapted to bring the Custom Notebook Image (CNBi) functionality to Open Data Hub. As part of this, a new CustomNBImage Custom Resource is being developed and implemented in the operator that covers the different use cases for CNBi.
Here is a demo of one of the use cases: to build an image from a git repository: https://asciinema.org/a/520388

Thoth Search UI dependency tree page - https://youtu.be/LrP7cgfSZKI
The new detail dependency tree page gives the user the ability to navigate through their dependency tree starting at the packages provided in the Pipfile. Users can view package and dependency warning counts, file sizes, and licenses for each branch of the dependency tree.

https://thoth-station.ninja/search/advise/adviser-220331140209-e5c79d78957854c3/dependency-tree

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

New Contributors

Full Changelog: v2022.08.23...v2022.09.14

Contributors

codificat, VannTen, and 3 other contributors
Assets 2
Loading

Release v2022.08.22

23 Aug 15:09
@harshad16 harshad16
v2022.08.23
17ed624
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.08.22

we have completed the release for v2022.08.22 🎉 🎊 🥳

Features

Improvement on Prescriptions and new inclusion
Prescriptions are now included with tag improvement for ease of processing. The scorecard prescription has these inclusions.
With these improvements, new prescriptions are released and included in the adviser.
thoth-station/prescriptions-refresh-job#177
thoth-station/prescriptions#27718
https://github.com/thoth-station/adviser/releases/tag/v0.56.2

Inclusion of License solver component in Thoth-station database

We have included the python_package_license table in the thoth-station database. It would store information on different licenses used by different packages, it would be used for providing useful information on the license of the package they are using.
thoth-station/storages#2647
https://github.com/thoth-station/license-solver

Thanks for the amazing work everyone. 💯

What's Changed

Full Changelog: v2022.08.09...v2022.08.23

Contributors

harshad16, Gregory-Pereira, and mayaCostantini
Assets 2
Loading

Release v2022.08.09

09 Aug 07:53
@harshad16 harshad16
v2022.08.09
ba56aca
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.08.09

we have completed the release for v2022.08.01 🎉 🎊 🥳

Features

Improvement on Thoth advises output
Implement tagging information generated on the prescriptions to generate separation on the output generation.

Improvements on Adviser documentation
Smaller corrections have been made to correct the typos and small mistakes on the adviser documentation.

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

  • Release of version 2022.07.12 by @khebhut in #2615
  • 😲 Update the kafka to stay inline with operate-first by @harshad16 in #2621
  • ⬆️ Updated the version of kebechet v0.10.2 by @harshad16 in #2623
  • ⬆️ Updated the version of kebechet v0.10.3 by @harshad16 in #2624
  • 🚢 Bump up version of the updated component in release v2022.08.01 by @harshad16 in #2625

Full Changelog: v2022.07.12...v2022.08.09

Contributors

harshad16
Assets 2
Loading

Release v2022.07.12

09 Aug 07:30
@harshad16 harshad16
v2022.07.12
844fda7
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.07.12

we have completed the release for v2022.07.11 🎉 🎊 🥳

Features

Thoth Adviser GitHub Action refactoring

Refactor the Action to allow more maintainability, allow users to specify CVEs to be ignored, introduce Job Summaries to report the state of the dependency resolution workflow.

Thoth integration into a pre-commit hook

Integrate Thoth recommendations on a project dependencies via a pre-commit hook using the Thamos CLI.

Implement autodiscovery for OpenBLAS, OpenMPI, cuDNN, MKL, hardware.gpu_model

Implement new auto-discovery methods for the thamos discover command for detecting OpenBLAS, OpenMPI, cuDNN, MKL and the GPU model present in the environment.

Prescriptions Refresh Job labels for BigQuery

In order to help us have better visibility into BigQuery usage, the queries from each handler that uses BigQuery are now labelled according to the handler that runs the job.

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

New Contributors

Full Changelog: v2022.06.22...v2022.07.12

Contributors

durandom, tumido, and 2 other contributors
Assets 2
Loading

Release v2022.06.22

22 Jun 18:29
@harshad16 harshad16
v2022.06.22
b488868
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
Release v2022.06.22

we have completed the release for v2022.06.20 🎉 🎊 🥳

Features

Project Thoth-station help site is up

Users can now use the project thoth-station help site https://thoth-station.ninja/help/, to get details on support, project thoth-station community structure, and metrics on the project.

Allow certain CVEs to be present in the application

Users of Thoth can now configure selectively which CVEs can be present in the application. It is possible to select which CVEs can be present in the application by enumerating them in the .thoth.yaml configuration file in labels section (comma separated listing):

labels:
  allow-cve: PYSEC-2014-10,PYSEC-2014-22,PYSEC-2014-23

Another option is to pass labels configuration to Thamos CLI:

thamos advise --labels allow-cve=PYSEC-2014-10,PYSEC-2014-22,PYSEC-2014-23

First Thoth Adviser GitHub Action release

The Thoth Adviser GitHub Action is now available on the GitHub Marketplace.

The action now supports overlays for users to get advise on different runtime environments:

And allows to ignore CVE specified in input:

Component Updates

Thanks for the amazing work everyone. 💯

What's Changed

Full Changelog: v2022.05.31...v2022.06.22

Contributors

tumido, harshad16, and 2 other contributors
Assets 2
Loading