Skip to content

azure.md

Latest commit

 

History

History
509 lines (468 loc) · 109 KB

azure.md

File metadata and controls

509 lines (468 loc) · 109 KB
Raw

Azure OpenAI & Copilot

Contents

Azure OpenAI & Foundry Overview

  • Abuse Monitoring - Data handling and retention policy for abuse detection in Azure OpenAI.
  • Azure OpenAI Models - 💡Catalog of foundation and reasoning models available from Azure OpenAI.
  • OpenAI Models - Catalog of foundation and reasoning models available from OpenAI.
  • What Is Azure OpenAI Service? - 💡Overview of Azure-hosted OpenAI capabilities, security and integration features.

Orchestration Frameworks

Prompt Engineering & Tooling

  • GenAIScript - JavaScript framework to orchestrate LLM calls, tools, and data in unified scripts. (Aug 2023) github stars
  • guidance - 💡DSL for structured prompting and controlled generation with chain-of-thought patterns. (Nov 2022) github stars
  • LLMLingua - 💡Prompt and KV-cache compression achieving substantial token reduction with minimal quality loss. (Jul 2023) github stars
  • LMOps - Toolkit for optimizing and evaluating prompt quality across multimodal scenarios. (Dec 2022) github stars
  • PromptBench - Unified framework for large language model prompt evaluation. (Jun 2023) github stars
  • Prompt Engine - Utilities for systematic prompt authoring and experimentation (Python variant available). (Jun 2022) github stars
  • Promptions - "Prompt" plus "options". Ephemeral UI for prompt refinement — a flexible dynamic prompt middleware. (Jul 2025) github stars
  • Prompty - Template language for prompt definition. (Apr 2024) github stars
  • SAMMO - Framework for automated prompt optimization through search and evaluation loops. (Apr 2024) github stars
  • TypeChat - 💡Schema-driven natural language interfaces using strongly typed APIs. github stars

Agent Frameworks

  • AGDebugger - Visual tool for AutoGen-based multi-agent debugging. (Jan 2025) github stars
  • Agent Harness: Scaling Capabilities - Adds skills, shell access, CodeAct, and background agents to a harness. (Jul 2026)
  • Agent Lightning - Train and optimize agents (including RL, prompt‑optimization, multi‑agent workflows). (Jun 2025) github stars
  • AIOpsLab - Research-driven AI agents for cloud incident analysis and root cause automation.
  • AutoGen - 🏆Customizable multi-agent conversation and tool orchestration framework (community AG2 and Microsoft variants). (Mar 2023) github stars
  • Copilot SDK - Multi-platform SDK for integrating GitHub Copilot Agent into apps and services. (Jan 2026) github stars
  • ExACT - Adaptive retrieval and planning using interaction memory and Monte Carlo Tree Search. (Dec 2024) github stars
  • JARVIS - Bridge connecting LLMs with specialized AI models for composite task execution. (Mar 2023) github stars
  • Magentic-Marketplace - Market simulation using agents. (27 Oct 2025) 2510.25779 github stars
  • Magentic-One - Generalist multi-agent system for complex multi-step automation.
  • OmniParser - 💡Vision-based GUI parsing for screen-grounded agent control. (Sep 2024) github stars
  • Qlib - Quantitative finance platform integrating supervised, temporal, and reinforcement modeling. (Aug 2020) github stars
  • RD-Agent - Open-source R&D automation for structured experimentation workflows. (Apr 2024) github stars
  • Semantic Workbench - Development environment for intelligent multi-agent scenario design and debugging. (Aug 2024) github stars
  • TaskWeaver - Code-first natural language to executable workflow translation with rich data planning. (Sep 2023) github stars
  • TinyTroupe - Multi-agent persona simulation for scenario exploration and insight generation. (Mar 2024) github stars
  • TypeAgent - Personal-agent architecture using structured prompting, action schemas, and Structured RAG memory. (Jul 2024) github stars
  • UFO - 💡UI-centric Windows interaction agent for system-level task automation. (Mar 2024) github stars
  • Vanilla AI Agents - Minimal agent patterns without heavy framework abstractions. (Dec 2024) github stars
  • Webwright - Terminal-driven browser agent framework with Playwright and reusable scripts. (May 2026) github stars
  • Windows Agent Arena - Benchmarking and evaluation platform for multimodal Windows desktop agents. (Sep 2024) github stars

Model Training & Inference

  • BitNet - Inference framework for ultra-low precision (1-bit) large language models. (Aug 2024) github stars
  • DeepSpeed - 🏆Distributed training and inference optimization library featuring ZeRO optimizations. (May 2020) github stars
  • FLAML - Lightweight automation for model selection, tuning, and economical experimentation. (Dec 2020) github stars
  • PixelCraft - High-fidelity visual reasoning on structured images. (Apr 2025) github stars
  • Tutel - Optimized Mixture-of-Experts (MoE) library with FP8/NVFP4/MXFP4 support. (Aug 2021) github stars
  • UniLM (Foundation Models) - Collection of large-scale pretrained architectures for multimodal and language tasks. (Mar 2020) github stars

Safety, Security & LLMOps

  • Agent 365 vs Foundry Agent Guardrails: Agent 365 governs agent identity, security, and lifecycle; Foundry Agent Guardrails control agent behavior rather than providing a custom governance platform.
  • Agent Governance Toolkit - Policy enforcement, identity, and sandboxing for secure enterprise agents. (Mar 2026) github stars
  • AI Central - Control plane for authenticated, resilient access to multiple OpenAI endpoints. (Oct 2023) github stars
  • Azure AI Content Safety - 💡Managed text and image moderation service, with APIs for harmful-content analysis, groundedness detection, protected material, and custom categories.
  • Azure AI Evaluation SDK - 💡Evaluation tooling for generative AI quality and safety metrics. (Oct 2024)
  • EvalsforAgentsInterop - Evaluates LLM-powered productivity agents through realistic scenario simulations. (Nov 2025) github stars
  • Foundry Control Plane and Agent 365 - Explains developer and IT governance control planes: Agent 365 → Purview → Defender → Foundry Guardrails → APIM → Content Safety → models. (May 2026)
  • MCP Enterprise Authorization - Explains Entra-governed MCP authorization and the EMA ID-JAG protocol. (Jul 2026)
  • MDASH - Multi-model agentic security harness for vulnerability discovery and proof. (May 2026)
  • Microsoft Entra Agent ID - Central registration and governance for organizational AI agents. (20 May 2025)
  • Not All Model Upgrades Are Upgrades - Shows why model changes need workload-specific cost and quality evaluation. (Jul 2026)
  • Presidio - 🏆Context-aware, pluggable PII detection and de-identification for text and images. (Oct 2019) github stars
  • Presidio Research - Data science tools for developing and evaluating Presidio PII recognizers. (Jan 2020) github stars
  • Prompt Shields - Azure AI Content Safety protection for direct user-prompt attacks and indirect prompt injection embedded in third-party documents.
  • PyRIT - 💡Risk identification toolkit targeting robustness, safety, and adversarial prompt detection. (Dec 2023) github stars
  • Securing MCP: A Control Plane for Agent Tool Execution - Introduces Agent Governance Toolkit for MCP tool definition scanning, policy enforcement, response inspection, identity, and audit logs. [Apr 2026]

Data Processing & Memory

  • Azure HorizonDB - New PostgreSQL service with advanced DiskANN vector indexing and large-scale replication. (19 Nov 2025)
  • Data Formulator - Iterative AI-assisted creation and transformation of data visualizations. (18 Sep 2023) github stars
  • DiskANN - 🏆Graph-based indices for scalable and fast approximate nearest neighbor search. (Jun 2020) github stars
  • Kernel Memory - Service and plugins for scalable ingestion, hybrid embedding, and memory pipelines. (Jul 2023) github stars
  • MarkItDown - 💡Conversion utility for office and structured documents to Markdown. (14 Nov 2024) github stars
  • Memora - Harmonic agent-memory representation balancing abstraction with specificity. (May 2026) github stars
  • Microsoft Fabric - Unified platform combining data integration, engineering, warehousing, and BI. (May 2023)
  • NLWeb - Conversational interfaces for web data with MCP, Schema.org, and RSS support. (Apr 2025) github stars

Dev Tools, MCP & Extensions

Copilot Product Catalog

Microsoft Foundry & AI Services

Azure AI Search

Agent Development

Microsoft 365 Agent Development

Learning Resources & Workshops

Microsoft Research

  • Arbor - Research agent project from RUC-NLPIR. (May 2026) github stars
  • AsyncThink - Asynchronous thinking protocol with organizer/worker fork–join actions extending sequential and parallel paradigms. (30 Oct 2025)
  • AutoGen Studio - A No-Code Developer Tool for Building and Debugging Multi-Agent Systems. (9 Aug 2024)
  • Azure AI Foundry Labs - Research driven tools and experimental projects.
  • Be My Eyes - A modular, multi-agent framework that extends LLMs to multimodal reasoning by coordinating efficient VLM perceivers (Qwen2.5-VL-7B) and powerful LLM reasoners (text-only DeepSeek-R1) through conversational collaboration. (24 Nov 2025)
  • Claimify - Extracting high-quality claims from language model outputs. (19 Mar 2025)
  • Data Formulator - AI-powered Concept-driven Visualization Authoring. (18 Sep 2023)
  • Data Formulator 2 - Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way. (18 Sep 2023)
  • Data Science Toolkit - Open-source collection of proven ML and AI implementation accelerators.
  • E5 - Embedding model for Multilingual and Mutitask. Contrastive Pre-training (CCPairs dataset — millions of high-quality pairs of related texts (e.g., paraphrases or semantically similar sentences). (Dec 2022)
  • Fara-7B - An Efficient Agentic Model for Computer Use. (24 Nov 2025) github stars
  • Flint - Visualization language for AI-generated chart specifications. (May 2026) github stars
  • GeoMind - A multi-agent system that lets non-experts query complex geospatial data in natural language. (28 Jan 2026)
  • GraphRAG (by Microsoft) - 🏆RAG with a graph-based approach to efficiently answer both specific and broad questions over large text. (24 Apr 2024)
  • Harrier - Microsoft open embedding model for retrieval and search. (Apr 2026)
  • Knowledge-Augmented Large Language Models for Personalized Contextual Query Suggestion - K-LaMP. Contextual memory layer for LLM application. (10 Nov 2023)
  • LIDA - LLM-powered data visualization and infographic generation from structured data. (Oct 2023) github stars
  • Magentic-One - A Generalist Multi-Agent System for Solving Complex Tasks.
  • Magentic-UI - Experimental human-centered web agent that can browse the web, run code, and process files.
  • MAI-Thinking-1, MAI-Code-1-Flash - Microsoft AI model family notes for reasoning, coding, and research models. MAI-Thinking-1 technical report. (Jun 2026)
  • MAI-Transcribe-1 - Microsoft speech-to-text model with strong multilingual WER, noisy-audio robustness, and Microsoft Foundry availability. [Apr 2026]
  • MarS - A Financial Market Simulation Engine Powered by Generative Foundation Model - Financial market simulation using generative AI. (4 Sep 2024) github stars
  • MatterGen - Generative model for inorganic materials design. (13 May 2024)
  • Memento - Extends effective output length by summarizing reasoning blocks and evicting old blocks from the KV cache. (Mar 2026) github stars
  • Microsoft AI Diagnostic Orchestrator (MAI-DxO) - Multi-Agent System. Accurately diagnoses up to 85% of NEJM case proceedings, which is over four times the rate achieved by a group of experienced physicians.
  • Microsoft Office Copilot: Natural Language Commanding via Program Synthesis - Semantic Interpreter, a natural language-friendly AI system for productivity software such as Microsoft Office that leverages large language models (LLMs) to execute user intent across application features. (6 Jun 2023)
  • Mnesis - A memory framework for LLMs combining similarity search with Global Selection, using a base graph for fast retrieval and a hierarchical graph for top-down semantic traversal. (17 Feb 2026) github stars
  • NL2KQL - From Natural Language to Kusto Query. (3 Apr 2024)
  • Optimizing Model Selection for Compound AI Systems - A framework that automatically optimizes model selection for compound AI systems. (20 Feb 2025)
  • PIKE-RAG - Specialized Knowledge & Rationale Augmentation Generation. (20 Jan 2025) github stars
  • PromptWizard - The prompt optimization through feedback-driven self-evolving prompts. (17 Dec 2024)
  • R&D-Agent-Quant - R&D-Agent for Quantitative Finance, in short RD-Agent(Q), the first data-centric multi-agent framework designed to automate the full-stack research and development of quantitative strategies via coordinated factor-model co-optimization. (21 May 2025)
  • SkillOpt - Trains reusable natural-language skills for frozen LLM agents. (May 2026) github stars
  • SpreadsheetLLM - Introduces an efficient method to encode Excel sheets, outperforming previous approaches with 25 times fewer tokens. (12 Jul 2024)
  • Synthetic Computers at Scale for Long-Horizon Productivity Simulation - Synthetic user-specific computer environments for scaling long-horizon productivity simulations and agent training. [May 2026]
  • The New Future of Work - Microsoft Research initiative studying meaningful, productive, equitable AI work. (2026)
  • TRELLIS.2 - 4B image-to-3D generation model using O-Voxel structured latents for high-fidelity textured assets. (Nov 2025) github stars
  • VeriTrail - Detecting hallucination and tracing provenance in multi-step AI workflows. (5 Aug 2025)
  • VibeVoice - Open-Source Text-to-Speech. (26 Aug 2025)

Sample Applications

Solution Accelerators

Code Samples & Workshops

Architecture Patterns & Use Cases