AngleSharp by AngleSharp

<PackageReference Include="AngleSharp" Version="1.0.2-alpha-273" />

 HtmlTokenizer

sealed class HtmlTokenizer : BaseTokenizer
Performs the tokenization of the source code. Follows the tokenization algorithm at: http://www.w3.org/html/wg/drafts/html/master/syntax.html
public bool IsAcceptingCharacterData { get; set; }

Gets or sets if CDATA sections are accepted.

public bool IsNotConsumingCharacterReferences { get; set; }

Gets or sets if character references should be avoided.

public bool IsPreservingAttributeNames { get; set; }

Gets or sets if attribute names should be taken as is.

public bool IsStrictMode { get; set; }

Gets or sets if strict mode is used.

public bool IsSupportingProcessingInstructions { get; set; }

Gets or sets if XML processing instructions should be parsed into DOM nodes.

public HtmlParseMode State { get; set; }

Gets or sets the current parse mode.

Fired in case of a parse error.

public HtmlTokenizer(TextSource source, IEntityProvider resolver)

See 8.2.4 Tokenization

public HtmlToken Get()

Gets the next available token.