Skip to content

Releases: redpanda-data/kminion

2.2.3 / 2023-03-29

29 Mar 11:36
@github-actions github-actions
v2.2.3
89c2276
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
2.2.3 / 2023-03-29

Changelog

Docker Image

Use the following command to pull this release's Docker image:

docker pull vectorized/kminion:v2.2.3

Contributors

andrewhsu, wreet, and 4 other contributors
Loading

2.2.2 / 2023-03-29

29 Mar 08:52
@github-actions github-actions
v2.2.2
89c2276
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
2.2.2 / 2023-03-29

Changelog

Docker Image

Use the following command to pull this release's Docker image:

docker pull vectorized/kminion:v2.2.2

Contributors

andrewhsu, wreet, and 4 other contributors
Loading

2.2.1 / 2022-11-24

24 Nov 11:19
@github-actions github-actions
v2.2.1
cdd8e59
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
2.2.1 / 2022-11-24

Changelog

Docker Image

Use the following command to pull this release's Docker image:

docker pull vectorized/kminion:v2.2.1

Contributors

alenkacz, amuraru, and 7 other contributors
Loading

2.2.0 / 2021-12-17

17 Dec 22:08
@github-actions github-actions
v2.2.0
d0d9e9d

Choose a tag to compare

View all tags
2.2.0 / 2021-12-17

Changelog

  • d0d9e9d Make E2E service accept a prometheus registerer
  • 2b50411 use right nil type to fix partition reassignments
  • 236d68c Validate number of specified brokers
  • 49300f0 Order imports
  • 63d501b Handle other protocolTypes than consumer properly
  • 461321b Lower produce request timeout to 3s
  • 5fdb775 Eagerly initialize failed metrics
  • ffa4211 Fix race condition in message tracker
  • a082b4e Fix typo in enum variable name
  • 059131a [Auto Commit] Package helm chart
  • 5adc178 Release v0.8.2
  • 8e169a7 Fix indenting
  • 0236e2e [Auto Commit] Package helm chart
  • 114cdb8 Release v0.8.1
  • 7ccca22 Fix broken format
  • f94e25b [Auto Commit] Package helm chart
  • d6a8030 Bump chart version
  • 41127e4 Add readiness probe for newer KMinion versions
  • fcd8c0c Only add consume config for appropriate scrapeMode
  • c1e922e Move comment into switch cases
  • fb5f4d4 Remove line break to improve readability
  • 62b1b51 Fix error handling for topic metadata response
  • 9960755 Merge pull request #129 from Scandiravian/handle_UnknownTopicOrPartition_error
  • 776cc2d Use typed error
  • c0f7ac6 Create topic instead of panic, when error is UnknownTopicOrPartition
  • 9162d2f Consider errors in metadata response for topic check
  • 26b2314 Merge pull request #128 from alenkacz/av/send-msg-immediately
  • 7c2e82e Send first e2e init message immediately
  • 21e8a6b Update to franz-go v1.2.2
  • d2b9046 Merge pull request #127 from alenkacz/av/helm-install
  • 357f8e5 Drop --name in helm install readme
  • 64d41d5 Merge pull request #124 from amuraru/pod-target-labels
  • d3016f8 Propage kminion pod custom labels as metrics labels
  • 8a393eb [Auto Commit] Package helm chart
  • 2ed9d5a Release version 0.7.0
  • e0d6dc5 Merge pull request #122 from stoader/metric_relabeling
  • a09adb0 Default value for serviceMonitor.relabelings
  • 0223754 Support metric relabeling
  • f5c6af4 [Auto Commit] Package helm chart
  • 877e893 Release chart version 0.6.0
  • 1dd4368 Merge pull request #119 from mrandreyeff/add_daemonset
  • 1dd0306 Merge pull request #105 from amuraru/issue-103
  • ed79c19 update according to changes in values
  • 4518838 change daemonset values structure
  • 3f84442 Merge pull request #120 from rashid4lyf/feature/add_scrape_timeout_interval
  • 89ea1c6 Merge remote-tracking branch 'origin/master' into feature/add_scrape_timeout_interval
  • 430d647 update values to 10s and 15s
  • af4fb49 Merge pull request #118 from mrandreyeff/add_targetLabels
  • 00eb355 Extract consumer group member_count as a separate metric
  • 7cbbc7d fix indent
  • 66e3435 support for dynamic scrapeTimeout and interval
  • caba0ad add daemonset template
  • 5536165 add serviceMonitor.targetLabels
  • dff9857 Merge pull request #106 from amuraru/issue-104
  • 4e87969 Implemented review comments
  • 320627b Export number of members and assigned partitions for each topic in a consumer group
  • 30f84f5 Fixes #111
  • 1e3a1d5 Introduce a state property that tracks whether a msg has been produced successfully or not
  • 7b6bd7e Fix partition reassignment and creation
  • a3558e0 Change default for commitSla to 5s
  • c4e5e82 Move to new cache lib
  • 02dbc3e Update franz-go to v0.10.2
  • f10fa9e Remove unused template literal
  • 01ff757 Use oneliner to access the Kafka message keys
  • 6901e62 Do not try to create or modify the topic if management is disabled
  • d38052f Fix offset commit metrics
  • ba20914 Use named loggers everywhere
  • 1545c20 Add clarifying log message during consumer init
  • f6ab00e Add timeout for consumer initialization
  • 6f76df2 Fix consumer initialization process for empty topics
  • 020c680 Make all message metrics vectors with partition id as label
  • 08dff9b Don't manage topics if not enabled
  • 7e882f2 Wait for a fully initialized consumer before starting the producer
  • 326337f Consume from newest offset
  • f6b7b3f Add messages to messagetracker before getting produce response
  • 3d59e90 Update franz-go to v0.9.1
  • d452033 Add partitionID in labels
  • 5e11446 Fix bug where we marked successfully received messages as lost
  • 634347d Rename metrics variable names
  • ded85bf Update to latest franz-go version
  • 4285a76 Add timeout for producing records
  • d0348bd Add timeout for producing records
  • e699e83 Add counter for lost messages
  • 244567c Move end to end message struct into it's own file
  • a2daa17 Refactor produce methods so that it is no longer sequential
  • 778e87c Remove TODO in regards to a metric tracking the failed produces
  • 1c46b56 Add metrics for produced messages
  • c0b7922 [Auto Commit] Package helm chart
  • 2d3d03f Release version 0.5.0
  • 01843a9 Add PodDisruptionBudget resource
  • 7381f6b Merge pull request #98 from amuraru/hlm
  • ec2c5de Tidy go mod
  • 52bb5f2 Merge pull request #109 from amuraru/update-deps
  • eddb2b8 Use consistent naming convention for log fields
  • d6048fd Update franz-go library to 0.9.0
  • aeb3b12 [helm-chart] Append customLabels to all resources if defined
  • a234a98 Document ensureCompatibility method
  • 5a7a20a Merge pull request #101 from amuraru/cached-groups
  • f96bc3a Introduce /ready endpoint that can be used in a readiness or startup probe
  • b6b6b4c Use cached consumer groups when listing offsets via Admin API
  • 63cba76 Merge pull request #97 from amuraru/moretopicconfigs
  • 032d501 Update minion/config_topic_config.go
  • a8a95ac Update minion/config_topic_config.go
  • 4cbfe01 Update minion/config_topic_config.go
  • 77249c3 Allow to export configurable set of topic configuration keys
  • 1a777bf Refactor some end-to-end functionality
  • 8157df5 Update to franz-go v0.8.0
  • 1ffd02b Print aggregated error summary
  • 3c7cfad Add partitions per broker default of 1
  • 01bedfc Fix reference config and change some e2e defaults
  • ec31cfd Merge branch 'master' of https://github.com/cloudhut/kminion
  • ce0423c update reference config
  • b435183 update reference config
  • 20bd38d Clarify what validateManagementTopic() does
  • 8d8c683 Use key from generated kmsg instead of comparing key name
  • 423e1c0 Merge branch 'endtoend'
  • 17ec4dd Update franz-go to v0.8.0
  • 0c33e52 Merge pull request #95 from Trackunit/feature/document-scrapemode
  • be3686c Also mention the increase in CPU usage when using scrapemode=offsetsTopic
  • 4305998 Document the difference between scrapemodes
  • 4948761 Fix formatting of e2e monitoring metrics
  • 5982e2c Fix some typos and reword a few things
  • ea47f26 Merge branch 'master' of https://github.com/cloudhut/kminion
  • 23a4d9a Update franz-go to v0.7.9
  • 10ed356 add e2e feature documentation, updated readme with link
  • ec428c0 fix issues when with logging string pointers
  • 390cf6f multiple changes: - remove rebalancingProtocol config, since there will never be any rebalancing in kminions consumer groups (since every kminion instance has exactly one, unique, consumer group that it uses) - change type of 'requiredAcks' from int to string (now takes 'all' or 'leader') - lots of functions have been refactored to use "early return" and/or split into logical steps so there aren't any huge functions - 'createEndToEndRecord' doesn't return an error anymore and instead panics. if serialization fails, there must be an issue that prevents kminion from running anyway - actually set 'ProduceRequestTimeout' to 'ackSla' config property - topic.go: complete rewrite: properly validate partition count, partition assignments, replication factor; considering potentially changing broker/partition count and replicationFactor; also now error checking for all potential errors in kafka responses (including nested errors, that are for example local to only one partition)
  • e262749 Merge pull request #90 from JoschaLaubach/fix-link-in-charts-docs
  • 405dbc5 docs: Fix link in Helm chart readme
  • 192bf30 message tracker, better comments, use time.Now() everywhere (no point in dealing with millis)
  • 3754be9 custom partitioner to send messages to predetermined partitions
  • 716f3e3 rename metric 'messages_commited_total' to 'commits_total' (since we're not comitting messages, but our "read offsets" per partition)
  • 0546a23 use hooks to track which broker sent a response to our offset commit
  • 6f7eb6d use new error reporting pattern in Produce after franz-go update, report broker_id instead of address in metrics
  • 9db7976 update packages, update to latest franz-go version, fix breaking changes
  • c2df9de rename "image-on-push" to "image-on-push-to-master", and create a new workflow that only builds images for pushes to any other (non-master) branch and tagging the image as "branchName-gitSha"
  • e1a8788 put deleting old consumer groups into its own file (group_tracker.go)
  • e36eb71 each kminion instance uses its own consumer group for end-to-end now so the instances don't "steal" messages from each other
  • d5a116c remove bytesSent/Received metrics from end to end
  • b4a08c5 more refactoring, seperate client hooks for each package
  • 1349666 move end-to-end into its own package called e2e
  • cc9a4e9 - remove SLA gauge metrics, they can be inferred from the 'inifinite' bucket in the latency histograms - methods to handle metric events (onAck, onRoundtrip, onOffsetCommit); will also soon be used to extract e2e into its own package - add _total and _seconds suffixes to metrics for best practices
  • a1ca198 update e2e topic config
  • 9813ad2 remove old methods; extract 'processMessage' for a small cleanup
  • c8e360a many changes: - new metrics (in 3 groups): low level, SLA indicators, latency histograms - don't put metrics results in a cache, instead directly increment/observe/set on promauto objects - only generate minionID once, don't create a new one for every message - actually check minionID to filter messages from other kminion instances - check timestamp to discard old messages and establish roundtrip latency - keep track of last received message timestamp, so we can detect/skip cases where we receive older messages for whatever reason - don't call storage.markRecordConsumed since that's only for offset_consumer
  • 4ae6088 log which partitions are lagging
  • b8c324d update franz-go to v0.6.14
  • be77e13 gitignore __de...
Read more
Loading

2.1.0 / 2021-04-21

21 Apr 07:56
@github-actions github-actions
v2.1.0
cc3d571

Choose a tag to compare

View all tags
2.1.0 / 2021-04-21

Changelog

cc3d571 Update franz-go to latest version
f6fafd3 Merge pull request #81 from amuraru/coordinator-id
43854e0 Don't use var for initializations
0a2a86b Add coordinator id to group info
50470fb Remove wrapper around sharded request response
48fd15d Add consumer group coordinator label to consumer_group_info metric
4f4b8c5 Align reference config with actually available config structs
6fd3af1 [Auto Commit] Package helm chart
5aa70be Release 0.3.1
49df52b Patch service monitor
88d760e Only trigger on push to Chart.yaml
b2cac79 [Auto Commit] Package helm chart
14992b9 Release 0.3.0
4321f33 [Auto Commit] Package helm chart
9568fa5 Merge pull request #76 from rjmasikome/master
ef366bf Add annotations to service on helm chart
deefcf8 [Auto Commit] Package helm chart
185e619 Release chart v0.2.2
358b66f [Auto Commit] Package helm chart
f764728 Merge pull request #75 from amuraru/patch
7152855 Fix helm default values
75daf70 Use dashes as separator for the date

Loading

2.0.0 / 03/07/2021

07 Mar 15:03
@github-actions github-actions
v2.0.0
0508cb9

Choose a tag to compare

View all tags
2.0.0 / 03/07/2021

Changelog

0508cb9 Fix name template syntax
1feb8a6 Rename workflow
19e4cef Fix semver template
82dec0f Adapt name template to only print the date
7826274 Trigger docker build on tag as well
fb715af Adapt name template for releases
ffcfeb7 Use tag-semver to tag docker images
3fd98e2 Add hint about YAML config filepath
a2caf1c Fixes issue #73
61c2aaa Embed Grafana dashboard screenshots
2ed58af Add dashboard screenshots
853d723 Document exported metrics
0ab0dcd Add metric that exposes the group's offset sum
e3a2f8e Remove expires_at label to fix metric series leak
6776026 Add topic_info metric
248a5af Use [email protected]
8db3809 Use right timestamp for low/high water mark request
a9e4731 Update to franz-go master
467a45f [Auto Commit] Package helm chart
b09935c Fix service monitor conditions
9909b52 [Auto Commit] Package helm chart
61e16c2 Bump chart version
82d1a82 Change default pod security context
e8ea8cc Add option to add custom labels
5e5b933 Add service monitor
f01a419 [Auto Commit] Package helm chart
1d30d0b Fix mountpath typo
2bd9106 [Auto Commit] Package helm chart
ff73aef Release 0.1.2
f79f484 Mount YAML config
c272aba Update license
dd0f65f [Auto Commit] Package helm chart
b7e4c58 Release patch with fixed default docker image repository
d954220 [Auto Commit] Package helm chart
25c65a9 Fix image repository default
461dfe4 [Auto Commit] Package helm chart
6e85184 Update secretKeyRefs documentation
0468f5e Add hint about Grafana Dashboards
a731aef Add CodeQL analysis
9e992b1 Add some emojis
8f28326 Fix typo
da7e96e Add go releaser with workflow for releases
143a9d1 Update to Go v1.16
47bb46d Link helm chart and docker image repo
bccf401 Add documentation how to install the chart
496d946 Ignore markdown files
523d3a4 [Auto Commit] Package helm chart
ef08128 Add chart release action
63ad696 Initial commit helm chart
c0e5dbb Ignore pushes to helm charts
5bdb40b Add sha- prefix to build arg
e55da5b Fixes issue #70
51ef31d Add support for comma separate env variables (WIP)
753af56 Try using the github.sha instead of reading from env variables
5c6f1f5 Try different syntax to inject env variable
2e2fc91 Try different syntax to inject env variable
b5095fa Add build image on push workflow
a209b9c Add image on push workflow
b91fad1 Fix env variable name
adc0e42 Document logger level option
622c156 Remove TODOs from Readme
b52aa2f Add metric for number of consumed offset records
71b1bbb Add logger with metrics
b6f0a31 Add metrics for number of offset commits and expiry time
86315ce Initial Commit README
88a6341 Make HTTP server socket configurable
13a2c0a Initial commit readme
17a8ba6 Add reference config
eb24133 Use right environment variable for exposing the version
f157ed4 Add Dockerfile and docker compose config
7d34e70 Remove TODO and add some short comments describing each block
c471b55 Add version to config struct
7529c9c Use Admin API by default
af75e99 Finalize offset consume
3c3f959 Use max concurrent fetches to prevent excessive memory usage
4c5d9cb Throw error if YAML config uses unused variables
1caeb0b Add consumer group lags
4813bc5 Initial commit v2
3a78fb0 Merge pull request #69 from PLarboulette/IMPROVEMENT-upgrade-kafka-2.6
e8822a2 feat(kafka-version): add docker-compose-kafka-2.6.yml to test kafka 2.6 / CP 6.0 compatibility

Loading

1.0.2 / 2020-09-28

28 Sep 07:40
@weeco weeco
v1.0.2
9842fdc

Choose a tag to compare

View all tags
1.0.2 / 2020-09-28
  • [BUGFIX] Fix Kerberos connection issues by upgrading Sarama
  • [BUGFIX] Fix Typo for Kerberos "USER_AUTH" login type (PR by ialeksandrov - #62)
  • [ENHANCEMENT] Add option to expose metrics for specific topics only (PR submitted by @moserke - #54)
Loading

1.0.1 / 2020-07-01

01 Jul 08:49
@weeco weeco
v1.0.1
ff2ef5e
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Choose a tag to compare

View all tags
1.0.1 / 2020-07-01
  • [CHANGE] Update dependencies
  • [CHANGE] Update to Go 1.14
Loading

First stable release

30 Jun 22:40
@weeco weeco
v1.0.0
8c5f459

Choose a tag to compare

View all tags
First stable release
  • A new metric kafka_minion_topic_subscribed_groups_count{topic} has been added. Great to find topics which have no consumer group offsets and therefore might be dead
  • New Grafana Dashboard for Cluster OPS is available (see #9)
    • Get metrics for any topics, regardless if they are being consumed or not
    • List of all consumer groups consuming this topic, including their consuming rate
    • Cluster metrics like:
      • Topic list by their subscriber count
      • Highest offset commit rates by group
      • Messages In Rates by Topics
      • Messages Out Rates by Topics
Loading

Stability improvements

16 Jun 11:04
@weeco weeco
v0.1.3
39fd905

Choose a tag to compare

View all tags
Stability improvements
  • In bigger Kafka Clusters Kafka Minion crashed regularly due to concurrent data access. This issue was identified and fixed by @birdayz (#4)
  • A bug where consumer group names, which only consist of digits caused a panic was fixed
Loading