Going into login loop of sentry

[rahulbalubankar]

Self-Hosted Version

24.12.0

CPU Architecture

x86_64

Docker Version

25.0.8

Docker Compose Version

v2.19.0

Machine Specification

• My system meets the minimum system requirements of Sentry

Steps to Reproduce

when i try to hit https://sentry-selfhosted.gamma.alt.meanion.com/auth/login/sentry/ it asks for login again... logs say 302 redirection for everything

description- I deployed 24.12.0 version of selfhosted sentry and having mulitple ec2 instances which are having selfhosted sentry deployed and i am accessing this sentry via domain that is mapped to alb dns. Also having asg to manage the scaling of these ec2. When ASG min=max=desired=1 sentry is accessible when i login using credentials but it goes into loop when i have multiple ec2 spinned and targets are healthy for alb.. Please help on this

Expected Result

i should be able to login and use sentry------

Actual Result

logs:
07:36:01 [INFO] sentry.access.api: api.access (method='POST' view='sentry.web.frontend.auth_organization_login.AuthOrganizationLoginView' response=302 user_id='None' is_app='None' token_type='None' is_frontend_request='True' organization_id='None' auth_id='None' path='/auth/login/sentry/' caller_ip='223.228.46.98' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.0473177433013916 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
07:36:03 [INFO] sentry.superuser: superuser.needs-validation (DISABLE_SU_FORM_U2F_CHECK_FOR_LOCAL=False self_hosted=True)
07:36:03 [INFO] sentry.superuser: superuser.logged-in (ip_address='223.228.46.98' user_id=1)
07:36:03 [INFO] sentry.auth: user.auth.success (ip_address='223.228.46.98' username='rahulbalu.bankar.ce@omf.com' organization_id=1)
07:36:03 [INFO] sentry.access.api: api.access (method='POST' view='sentry.auth.providers.saml2.provider.SAML2AcceptACSView' response=302 user_id='1' is_app='None' token_type='None' is_frontend_request='True' organization_id='None' auth_id='None' path='/saml/acs/sentry/' caller_ip='223.228.46.98' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.14129400253295898 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
07:36:03 [INFO] sentry.access.api: api.access (method='GET' view='sentry.web.frontend.auth_organization_login.AuthOrganizationLoginView' response=200 user_id='None' is_app='None' token_type='None' is_frontend_request='True' organization_id='None' auth_id='None' path='/auth/login/sentry/' caller_ip='223.228.46.98' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.033577919006347656 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
07:36:39 [INFO] sentry.access.api: api.access (method='GET' view='sentry.web.frontend.react_page.ReactPageView' response=302 user_id='None' is_app='None' token_type='None' is_frontend_request='True' organization_id='None' auth_id='None' path='/organizations/sentry/issues/' caller_ip='223.228.46.98' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.002358675003051758 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')

07:41:27 [INFO] sentry.access.api: api.access (method='GET' view='sentry.web.frontend.auth_login.AuthLoginView' response=302 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/auth/login/' caller_ip='147.185.133.235' user_agent='Expanse, a Palo Alto Networks company, searches across the global IPv4 space multiple times per day to identify customers' presences on the Internet. If you would like to be excluded from our scans, please send IP addresses/domains to: scaninfo@paloaltonetworks.com' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.1318502426147461 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
07:42:27 [INFO] sentry.access.api: api.access (method='GET' view='sentry.web.frontend.auth_login.AuthLoginView' response=302 user_id='None' is_app='None' token_type='None' is_frontend_request='True' organization_id='None' auth_id='None' path='/auth/login/' caller_ip='223.228.46.98' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.02491450309753418 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')

Event ID

No response

[aldy505]

having mulitple ec2 instances which are having selfhosted sentry deployed and i am accessing this sentry via domain that is mapped to alb dns

Can you give some details on how you deploy or setup your self-hosted Sentry so that you think you can horizontally scale this? Do you have centralized database? Do those EC2 instances that you put behind the AWS ALB points to a single dedicated Memcached, ClickHouse, Postgres, and Redis?

[rahulbalubankar]

Hi @aldy505 , Yes I have seperated out kafka(deployed on aws ec2 and its working fine- removed container from docker-compose), using aws rds postgresql(working as expected and have dummy postgresql service running instead under docker-compose), using aws elasticache for redis(Integration is working as expected), also clickhouse have deployed on aws EC2 and integrated in dockercompose.yml file and its working as expected, I have integrated Memcached too......I have deployed these under same vpc-- using alb with ASG and each ec2 instance is cloning the code selfhosted-sentry-24.12.0.zip when it first gets created as per utilization according to asg and then runs install.sh script and then dockercompose to bring up containers as per dockercompose.yml... I am modifying this docker-compose.ym file via userdata script on ec2 instances to integrate external components like kafka rds and redis etc.

[rahulbalubankar]

The components you mentioned are single dedicated seperated. I also have one question.. do i need to seperate out symbolicator as well? ... Please help on the issue... Thanks for responding..

[aldy505]

The components you mentioned are single dedicated seperated. I also have one question.. do i need to seperate out symbolicator as well? ... Please help on the issue... Thanks for responding..

No you don't need to separate out symbolicator. It is stateless.

If this is taking too much of your time, I would suggest to not deploy Sentry behind an autoscaling group and just spawn a single EC2 instance, either m4.2xlarge, m5a.2xlarge or m5.2xlarge will do. Attach it to gp3 EBS volume with minimum space of 100 GB. Then get a S3 bucket, setup external storage: https://develop.sentry.dev/self-hosted/experimental/external-storage/ and https://github.com/stayallive/sentry-nodestore-s3. You should be able to go for minimum of 2 million events per month. If you still want more throughput, just put an external Kafka instance.