Registry / utility / rustc-ap-rustc-lexer

rustc-ap-rustc-lexer

library727.0.0rscratesunverified

Automatically published version of the rustc_lexer crate from the Rust compiler repository.

# Cargo.toml
[dependencies]
rustc-ap-rustc_lexer = "727.0.0"

INSTALL

IMPORT

SIG · RUSTC-AP-RUSTC-LEX

rustc-ap-rustc-lexer

utilityrustv727.0.0

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

tokenize

✓ use rustc_lexer::tokenize;

Tokenizes a Rust source string.

use rustc_lexer::tokenize; fn main() { let tokens: Vec<_> = tokenize("fn main() {}").collect(); println!("Tokenized {} tokens", tokens.len()); }

Debug

Known issues

gotchaThis is an auto-published snapshot; API may differ from the official rustc_lexer.

fix

Use the official rustc_lexer crate if you need stability.

affects: *

Upgrade

Version history

727.0.0latest on crates.io

Audit

Dependencies

No dependency data recorded yet.

Agent activity

6 hits · last 30 days

node

Resources