AngleSharp by Florian Rappl

<PackageReference Include="AngleSharp" Version="0.8.7" />

.NET API 1,175,040 bytes

 HtmlTokenizer

sealed class HtmlTokenizer : BaseTokenizer
Performs the tokenization of the source code. Follows the tokenization algorithm at: http://www.w3.org/html/wg/drafts/html/master/syntax.html
public bool IsAcceptingCharacterData { get; set; }

Gets or sets if CDATA sections are accepted.

public HtmlParseMode State { get; set; }

Gets or sets the current parse mode.

public HtmlTokenizer(TextSource source, IEventAggregator events)

See 8.2.4 Tokenization

public HtmlToken Get()

Gets the next available token.

public void RaiseErrorOccurred(HtmlParseError error, TextPosition position)

Fires an error occurred event.

public void RaiseErrorOccurred(HtmlParseError code)

Fires an error occurred event at the current position.