Tokenizer Class Reference

List of all members.

Public Member Functions
	Tokenizer ()
	newFromString ($s)
	previewToken ()
	nextToken ()
	continues ($cont)
	preceeded ($prec)
	readAllUntil ($border)
Public Attributes
	$mText
	$mPos
	$mTextLength
	$mQueuedToken

---

Constructor & Destructor Documentation

Tokenizer::Tokenizer (   )

Definition at line 9 of file Tokenizer.php. References $wgLang. Referenced by newFromString().

---

Member Function Documentation

Tokenizer::continues (  $  cont  )

Definition at line 261 of file Tokenizer.php. References $i, and continues(). Referenced by continues(), and nextToken().

Tokenizer::newFromString (  $  s  )

Definition at line 19 of file Tokenizer.php. References $s, newFromString(), Tokenizer(), wfProfileIn(), and wfProfileOut(). Referenced by newFromString().

Tokenizer::nextToken (   )

Definition at line 61 of file Tokenizer.php. References continues(), nextToken(), preceeded(), wfProfileIn(), and wfProfileOut(). Referenced by nextToken(), and previewToken().

Tokenizer::preceeded (  $  prec  )

Definition at line 276 of file Tokenizer.php. References preceeded(). Referenced by nextToken(), and preceeded().

Tokenizer::previewToken (   )

Definition at line 38 of file Tokenizer.php. References nextToken(), previewToken(), wfProfileIn(), and wfProfileOut(). Referenced by previewToken().

Tokenizer::readAllUntil (  $  border  )

Definition at line 285 of file Tokenizer.php. References $n, n, and readAllUntil(). Referenced by readAllUntil().

---

Member Data Documentation

Tokenizer::$mPos

Definition at line 3 of file Tokenizer.php.

Tokenizer::$mQueuedToken

Definition at line 3 of file Tokenizer.php.

Tokenizer::$mText

Definition at line 3 of file Tokenizer.php.

Tokenizer::$mTextLength

Definition at line 3 of file Tokenizer.php.

---

The documentation for this class was generated from the following file:

• Tokenizer.php

---