Share via


AzureOpenAITokenizerParameters Class

Definition

The AzureOpenAITokenizerParameters.

public class AzureOpenAITokenizerParameters : System.ClientModel.Primitives.IJsonModel<Azure.Search.Documents.Indexes.Models.AzureOpenAITokenizerParameters>, System.ClientModel.Primitives.IPersistableModel<Azure.Search.Documents.Indexes.Models.AzureOpenAITokenizerParameters>
type AzureOpenAITokenizerParameters = class
    interface IJsonModel<AzureOpenAITokenizerParameters>
    interface IPersistableModel<AzureOpenAITokenizerParameters>
Public Class AzureOpenAITokenizerParameters
Implements IJsonModel(Of AzureOpenAITokenizerParameters), IPersistableModel(Of AzureOpenAITokenizerParameters)
Inheritance
AzureOpenAITokenizerParameters
Implements

Constructors

AzureOpenAITokenizerParameters()

Initializes a new instance of AzureOpenAITokenizerParameters.

Properties

AllowedSpecialTokens

(Optional) Only applies if the unit is set to azureOpenAITokens. This parameter defines a collection of special tokens that are permitted within the tokenization process.

EncoderModelName

Only applies if the unit is set to azureOpenAITokens. Options include 'R50k_base', 'P50k_base', 'P50k_edit' and 'CL100k_base'. The default value is 'CL100k_base'.

Methods

JsonModelWriteCore(Utf8JsonWriter, ModelReaderWriterOptions)

Explicit Interface Implementations

IJsonModel<AzureOpenAITokenizerParameters>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

IJsonModel<AzureOpenAITokenizerParameters>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

IPersistableModel<AzureOpenAITokenizerParameters>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

IPersistableModel<AzureOpenAITokenizerParameters>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

IPersistableModel<AzureOpenAITokenizerParameters>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

Applies to