epic: User Mangement / Adiminstration + Backoffice UI

[LazyYuuki]

• Back Office UI
• Follow OpenAI implementation
• Centralized LLM Access Management: Allow admins to configure and share API keys for cloud models, with user-specific API key issuance. ( Organization / Project)
• Retain conversation history for compliance.
• Billing and Quota Enforcement: Enable real-time usage metering and quota enforcement through the Gateway, attributing costs to users/orgs and preventing overages, with async event logging for downstream billing aggregation.
• Out of scope:
  • Payment gateway
  • Won't provide as a SaaS at the moment

[jjchen01]

• The platform will have a default admin key.
• Create a default organization and project for end-users upon server initialization.
• Organizations for admins, companies, and enterprise editions.
• Organization: chat.jan.ai
• Project for end-users.
• Roles: Admins / End-users.
• End-users cannot access admin endpoints.
• Admin endpoints can only be accessed by admins.
• The default admin can grant privileges to other admins via invites or admin keys.
• End-users have write privileges to CRUD their API keys in the default project.