Registry / utility / scalding-core-2-10

scalding-core-2-10

library0.16.0javamavenunverified

Scalding is a Scala library that simplifies the development of MapReduce jobs by providing a high-level API for data processing.

utility

<dependency>
  <groupId>com.twitter</groupId>
  <artifactId>scalding-core_2.10</artifactId>
  <version>0.16.0</version>
</dependency>

github ↗homepage ↗docs ↗

INSTALL

IMPORT

SIG · SCALDING-CORE-2-10

scalding-core-2-10

utilityjavav0.16.0

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Job

✓ com.twitter.scalding._

Minimal Scalding job that counts words from a text file.

import com.twitter.scalding._ class WordCountJob(args: Args) extends Job(args) { TextLine(args("input")) .flatMap('line -> 'word) { line: String => line.split("\\s+") } .groupBy('word) { _.size } .write(Tsv(args("output"))) }

Debug

Known issues

breakingScalding 0.16.0 is compatible with Scala 2.10, but newer versions require Scala 2.11+.

fix

Upgrade to a newer Scalding version and Scala version if possible.

affects: <=0.16.0

Upgrade

Version history

0.16.0latest on Maven

Audit

Dependencies

No dependency data recorded yet.

Agent activity

13 hits · last 30 days

node

Amazon

Resources

githubhttps://github.com/twitter/scalding ↗

homepagehttps://github.com/twitter/scalding ↗

docshttps://appdoc.app/artifact/com.twitter/scalding-core_2.10/ ↗