Short answer
Azure OpenAI resells OpenAI's models inside an Azure subscription at the same list price: GPT-5.6-terra at $2.00 input and $12.00 output per million tokens on Global Standard. That is the short-context meter — the same model's long-context meters are $4.00 and $18.00, so a price quoted without its context tier understates a long-context bill by 50 to 100%.[1] Stay if procurement and compliance already run through Azure, if processing has to stay inside a US or EU data zone, and if provisioned capacity stays busy. Look for an alternative when the 18-month retirement clock and automatic upgrades keep reopening finished work, when provisioned throughput bills by the hour whether it is used or not, or when data must never leave your own servers. The alternatives are OpenAI direct, which already sells a GPT-6 generation whose gpt-6-sol costs $10.00 per million output against gpt-5.6-terra's $12.00[2]; Amazon Bedrock; or an open-weight model you host yourself.
Azure OpenAI is OpenAI's models sold under a Microsoft contract, inside an Azure subscription, on Microsoft's datacentres. Three things decide whether that wrapper is worth it: which meter your traffic lands on, whether you pay for capacity by the hour, and how long a model you have tested stays available.
Azure's retail price list for East US 2 carries GPT-5.6-terra at $2.00 per million input tokens and $12.00 per million output on Global Standard — the meters 5.6 terra ShortCo Inp Std Gl and 5.6 terra ShortCo Opt Std Gl. Those are the short-context meters. The same model's long-context meters, 5.6 terra LongCo Inp Std Gl and 5.6 terra LongCo Opt Std Gl, read $4.00 and $18.00. Data Zone Standard adds exactly 10% to the short-context pair: 5.6 terra ShortCo Inp Std DZ at $2.20 and 5.6 terra ShortCo Opt Std DZ at $13.20.[1] A budget built on the headline $2.00 and $12.00 without naming the context tier is 50 to 100% short on long-context traffic.
OpenAI's own list carries the same $2.00 input and $12.00 output for gpt-5.6-terra, with cached input at $0.20, cache writes at $2.50, the Batch API at exactly half ($1.00 and $6.00) and Fast mode at exactly double ($4.00 and $24.00). Above that model now sits a GPT-6 flagship table: gpt-6-astra at $10.00 and $50.00 per million, gpt-6-sol at $2.00 and $10.00, gpt-6-luna at $0.10 and $0.50.[2] gpt-6-sol costs the same per input token as gpt-5.6-terra and less per output token, $10.00 against $12.00, so anchoring a comparison on gpt-5.6-terra now anchors it on a model its own successor undercuts.
Azure has not finished publishing that generation. Its pricing page already lists GPT-6 Astra in the minimum-PTU table, but the model prices come with a notice: "Notice: GPT-6 Sol and Luna prices are currently in processing for publishing on this page. Please find the model pricing in the blog."[3] Until that lands, the price of the model you would deploy today has to be read somewhere other than the pricing page.
The Batch API "returns completions within 24 hours for a 50% discount on Global Standard Pricing". Provisioned throughput is a different meter: "You are charged an hourly rate per model regardless of usage", with "monthly and annual reservations available to reduce overall spend" — the page states no term commitment either way. Minimum sizes for GPT-5.6-terra at short context are 15 PTUs on Global, 15 on Data Zone and 50 on Regional.[3] The retail price list puts those units at $1.00 an hour for Provisioned Managed Global Unit, $1.10 for Provisioned Managed Data Zone Unit and $2.00 for Provisioned Managed Regional Unit.[4]
An Azure OpenAI model ages on a published clock: the "Retirement date (18 months out) is set programmatically" at launch, new customers can no longer deploy it at 12 months, and "At 18 months from launch, all inference returns 410 Gone". Notice for generally available models is "At least 60 days", and "Retirement dates aren't extendable". Standard deployments are upgraded for you, region by region (gpt-4o version 2024-05-13 moves to gpt-5.1 on 2026-10-01), while "Provisioned deployments are NOT auto-upgraded" and are migrated by hand.[5] The 18 months do not generalise across the catalogue: on the same page, generally available models from Anthropic, DeepSeek, Fireworks and Mistral follow a 12-month lifecycle.[5]
The platform around the models has been renamed twice, and Microsoft's own migration page traces the chain: "Azure AI Studio → Azure AI Foundry → to Microsoft Foundry (current)". On August 26, 2026 the azure-ai-inference package retired and the Assistants API sunset; the recommended client became the standard OpenAI() with a base_url in place of AzureOpenAI(), authenticating through DefaultAzureCredential.[6] Renames are not outages, but each one moves documentation, portal paths and SDK names under work that was finished.
| Azure OpenAI | OpenAI API direct | Amazon Bedrock | Self-hosted open-weight model (vLLM) | |
|---|---|---|---|---|
| Code and data ownership | Prompts, completions, embeddings and training data "are NOT available to OpenAI or other providers of Models sold by Azure" and "are NOT used to train any generative AI foundation models without your permission or instruction"; "Your fine-tuned Models sold by Azure are available exclusively for your use"[7] | Services Agreement §4.1: "Customer: (a) retains all ownership rights in Input; and (b) owns all Output."[9] API data is not used for training unless you opt in, and abuse-monitoring logs are kept up to 30 days[8] | "With Amazon Bedrock, your content is not used to improve the base models and is not shared with any model providers."[10] | Prompts, outputs and weights stay on your servers |
| Cost model | Global Standard at OpenAI list prices: $2.00 / $12.00 per million short context, $4.00 / $18.00 long context, Data Zone +10%[1]. Provisioned units from $1.00 an hour[4], minimum 15 on Global[3] | gpt-5.6-terra $2.00 / $12.00 per million, Batch $1.00 / $6.00, Fast mode $4.00 / $24.00; gpt-6-sol $2.00 / $10.00; regional endpoints add 10% for models released on or after March 5, 2026[2] | "OpenAI models in Amazon Bedrock are billed through AWS. Bedrock pricing in commercial regions matches OpenAI direct pricing for equivalent services."[2] | GPU hours or owned hardware: Standard_NC40ads_H100_v5 on Azure is $6.98 an hour on demand in East US[13] |
| Time to launch | A resource and a deployment, subject to region: "Not all model and version combinations are available in all regions"[5] | An API key | An AWS account and model access | vllm serve openai/gpt-oss-120b gives a first endpoint[15]; the production controls around it are the work |
| Lock-in: notice, clock, upgrades | Retirement 18 months after launch, "Retirement dates aren't extendable", "At least 60 days" notice for GA models; Standard deployments auto-upgraded, "Provisioned deployments are NOT auto-upgraded"[5]. "Monthly and annual reservations available to reduce overall spend", with no term commitment stated either way[3] | "Generally available models: At least 6 months." of notice[12] | "There are two Legacy periods: 6 months and 45 days. Most models have a 6-month Legacy period."; "existing customers may lose access after 15 days of inactivity"; the dates "may differ from dates published by model providers"[11] | No retirement clock: you upgrade when your evaluation says so |
| Customisation | Fine-tuning, with "Your fine-tuned Models sold by Azure are available exclusively for your use"[7] | Closing: "OpenAI is winding down the fine-tuning platform. The platform is no longer accessible to new users, but existing users of the fine-tuning platform will be able to create training jobs for the coming months. All fine-tuned models will remain available for inference until their base models are deprecated."[2] | Per model and per provider | Quantization, "Efficient multi-LoRA support" and "structured outputs using xgrammar or guidance"[16] |
| Compliance and data residency | Global means "any geography where the relevant model sold by Azure is deployed"; Data Zone keeps processing in the US or the EU; Regional covers up to 27 regions; data at rest stays in the geography you designate[7] | Exactly ten residency regions: US, Europe (EEA + Switzerland), Australia, Canada, Japan, India, Singapore, South Korea, United Kingdom and UAE. Outside the US "you must be approved for abuse monitoring controls, and execute a Modified Retention amendment"[8] | "Any customer content processed by Amazon Bedrock is encrypted and stored at rest in the AWS Region where you are using Amazon Bedrock."[10] | Wherever your servers are |
| Latency and scale | Provisioned throughput reserves capacity; "Microsoft can limit new customers in specific regions"[5] | Shared capacity, with Fast mode at exactly double the standard price: $4.00 and $24.00 per million[2] | Provisioned Throughput for some models, but "You can't create a new Provisioned Throughput for models in the Legacy state."[11] | Dedicated GPUs, with "Tensor, pipeline, data, expert, and context parallelism" across them[16] |
| Exit cost | Low in code: Microsoft's own mapping replaces AzureOpenAI() with OpenAI() plus a base_url and describes the result as "Azure-specific code eliminated"[6]. Re-testing every workload is the real cost | Re-test on the next model | Re-test on the next model | vLLM serves an OpenAI-compatible API, so the same client shape reaches a self-hosted endpoint[17]; hardware and the team that runs it are the cost |
DefaultAzureCredential,[6] and "Your fine-tuned Models sold by Azure are available exclusively for your use".[7]2024-05-13 moves to gpt-5.1 on 2026-10-01.[5] The model generation moves faster than the clock: OpenAI already lists a GPT-6 family[2] while Azure's pricing page still says Sol and Luna prices are "currently in processing for publishing on this page".[3]lifecycleStatus and deprecationDate from the Models API,[5] and mark which of them a monthly or an annual reservation covers.[3]AzureOpenAI() with OpenAI() and a base_url, and calls the result "Azure-specific code eliminated".[6] The same client shape then reaches a self-hosted endpoint, because vLLM serves an OpenAI-compatible API.[17]Compare like with like. The 15-PTU Global minimum at the published hourly rate is about $10,950 a month — 15 × $1.00 × 730.[3][4] That buys roughly two on-demand H100 machines on Azure: Standard_NC40ads_H100_v5 is $6.98 an hour in East US, and 2 × $6.98 × 730 is $10,190.80 a month.[13] The capacities are not equivalent. The PTUs serve GPT-5.6; the GPUs serve an open-weight model such as gpt-oss-120b, which is Apache 2.0 and is quantised with the aim of "making gpt-oss-120b run on a single 80GB GPU".[15] Score that model on your evaluation set before comparing invoices: the price says nothing about whether it is good enough.
These are the cost drivers, not a price.
| Cost driver | What drives it | Public reference point |
|---|---|---|
| GPU capacity | Model size, context length, concurrency | Standard_NC40ads_H100_v5, Consumption Linux, East US: $6.98 an hour[13]. Microsoft's size page describes the series as "powered by NVIDIA H100 NVL GPU", Accelerators (Qty.) 1, Accelerator-Memory (GB) 94[14] |
| Model fit and licence | Parameters, quantisation, commercial terms | gpt-oss-120b is Apache 2.0 and quantised with the aim of "making gpt-oss-120b run on a single 80GB GPU", while "the gpt-oss-20b model run within 16GB of memory"[15] |
| Redundancy | A second machine so one failure does not stop the service | Doubles the GPU line: 2 × $6.98 × 730 = $10,190.80 a month[13] |
| Security layer | Authentication, network isolation and logging in front of the server | vLLM's --api-key "only authenticates requests to endpoints under the /v1, /v2, and /inference path prefixes", /invocations is not authenticated, and the docs say "Do not rely on --api-key alone to secure vLLM"[17] |
| Evaluation | A test set per workload, rerun on every model change | No public reference point; scoped per project |
| Operations | Upgrades, monitoring, on-call | No public reference point; scoped per project |
On Global Standard, no: GPT-5.6-terra lists at $2.00 input and $12.00 output per million on both — and on Azure that is the short-context meter, with long context at $4.00 and $18.00.[1][2] Data Zone Standard costs exactly 10% more on Azure ($2.20 and $13.20), and OpenAI's own regional endpoints add 10% for models released on or after March 5, 2026.[1][2]
For an Azure OpenAI model, 18 months after launch: the "Retirement date (18 months out) is set programmatically" and is visible through the Models API. Generally available models get "At least 60 days" notice, and "Retirement dates aren't extendable".[5] The figure does not carry across the catalogue — GA models from Anthropic, DeepSeek, Fireworks and Mistral on the same platform follow a 12-month lifecycle.[5]
Standard deployments are upgraded automatically to the replacement model (gpt-4o 2024-05-13 to gpt-5.1 on 2026-10-01), while "Provisioned deployments are NOT auto-upgraded" and have to be migrated by hand. After the date, "all inference returns 410 Gone".[5]
No. Microsoft states that prompts, completions, embeddings and training data "are NOT available to OpenAI or other providers of Models sold by Azure", and that they "are NOT used to train any generative AI foundation models without your permission or instruction".[7]
Not as a new customer. OpenAI's pricing page states: "OpenAI is winding down the fine-tuning platform. The platform is no longer accessible to new users, but existing users of the fine-tuning platform will be able to create training jobs for the coming months. All fine-tuned models will remain available for inference until their base models are deprecated."[2] On Azure, fine-tuning is still offered, and "Your fine-tuned Models sold by Azure are available exclusively for your use".[7]
OpenAI's open-weight models, yes: gpt-oss-120b and gpt-oss-20b are Apache 2.0, quantised with the aim of "making gpt-oss-120b run on a single 80GB GPU" and of letting "the gpt-oss-20b model run within 16GB of memory".[15] The GPT-5.6 and GPT-6 families are sold through APIs — OpenAI and Azure both list them,[2][1] and OpenAI states that "OpenAI models in Amazon Bedrock are billed through AWS."[2] Which route fits is the question behind OpenAI API vs a self-hosted LLM and vLLM vs Ollama.
About amBrain
Disclosure: this page is published by amBrain. The last column of the comparison table is the kind of work amBrain does. Every vendor fact on this page links to its source and carries the date that source was read; model prices move often, and every figure here was read on 2026-09-23. No vendor named here reviewed or endorsed this page. Azure, Microsoft Foundry, OpenAI, GPT, Amazon Bedrock, AWS, NVIDIA and vLLM are trademarks of their owners and are used only to identify the products discussed.
Standard_NC40ads_H100_v5, Consumption Linux, $6.98 per hour; the payload carries no GPU count and no memory size). Vendor's own page · checked Sep 23, 2026Related