Commits

Branch selector

 cc

User selector

All users

Datepicker

All time

Commit History

Commits on May 4, 2025

• Add tool UrlSamplerHost:

  Show description for 29b4494
  sebastian-nagel

  committed
  29b4494

  Copy full SHA for 29b4494

Commits on Mar 15, 2025

• WarcCdxWriter: normalize URL of redirect target location

  Show description for ce36046
  sebastian-nagel

  committed
  ce36046

  Copy full SHA for ce36046

Commits on Jan 8, 2025

• Merge upstream branch 'master' into cc

  sebastian-nagel

  committed
  fcb6640

  Copy full SHA for fcb6640

• Upgrade webarchive-commons dependency (1.1.11 -> 1.3.0)

  sebastian-nagel

  committed
  6b2d9ea

  Copy full SHA for 6b2d9ea

• Merge pull request #832 from sebastian-nagel/NUTCH-3072

  Show description for 3b6d2c6
  sebastian-nagel

  authored
  3b6d2c6

  Copy full SHA for 3b6d2c6

• NUTCH-3086 Consolidate plugin extension names and IDs (#835)

  sebastian-nagel

  authored
  74b49e9

  Copy full SHA for 74b49e9

• Merge pull request #844 from maciejpuzianowski/NUTCH-3097

  Show description for 5068b76
  sebastian-nagel

  authored
  5068b76

  Copy full SHA for 5068b76

Commits on Dec 4, 2024

• NUTCH-3079 Dumping a segment fails unless it has been fetched and parsed

  Show description for 86b893a
  sebastian-nagel

  committed
  86b893a

  Copy full SHA for 86b893a

• NUTCH-3083 Add RobotRulesParser to bin/nutch

  Show description for b481f91
  sebastian-nagel

  committed
  b481f91

  Copy full SHA for b481f91

• NUTCH-3096 HostDB ResolverThread can create too many job counters

  Show description for 5263b7c
  sebastian-nagel

  committed
  5263b7c

  Copy full SHA for 5263b7c

Commits on Dec 3, 2024

• NUTCH-3092 Replace all imports of commons-lang by commons-lang3

  sebastian-nagel

  committed
  e2a29d0

  Copy full SHA for e2a29d0

• fix for NUTCH-3097 contributed by maciejpuzianowski/mpuzianowski

  maciejpuzianowski

  committed
  bb17570

  Copy full SHA for bb17570

• NUTCH-3094 Github tests to run if build configuration changes

  Show description for 5a01834
  sebastian-nagel

  committed
  5a01834

  Copy full SHA for 5a01834

• NUTCH-3094 Github tests to run if build configuration changes

  sebastian-nagel

  committed
  68c1a7d

  Copy full SHA for 68c1a7d

• NUTCH-3095 Update .gitignore to ignore Hadoop native libraries

  sebastian-nagel

  committed
  6bff123

  Copy full SHA for 6bff123

Commits on Nov 30, 2024

• NUTCH-3093 Ant target test-plugins to depend on compile-core-test (#840)

  sebastian-nagel

  authored
  5fc8ed0

  Copy full SHA for 5fc8ed0

• NUTCH-3072 Fetcher to stop QueueFeeder if aborting with "hung threads"

  Show description for 44e9041
  sebastian-nagel

  committed
  44e9041

  Copy full SHA for 44e9041

• NUTCH-3072 Fetcher to stop QueueFeeder if aborting with "hung threads"

  Show description for c226162
  sebastian-nagel

  committed
  c226162

  Copy full SHA for c226162

Commits on Nov 28, 2024

• Update URLUtil test to adapt to a change in the public suffix list

  sebastian-nagel

  committed
  1ae0a11

  Copy full SHA for 1ae0a11

Commits on Nov 27, 2024

• NUTCH-3093 Ant target test-plugins to depend on compile-core-test

  sebastian-nagel

  committed
  e8469bc

  Copy full SHA for e8469bc

• Adapt Github workflow to build the branch 'cc' to depend on a

  Show description for 062c08f
  sebastian-nagel

  committed
  062c08f

  Copy full SHA for 062c08f

• Update URLUtil to changes in crawler-commons's EffectiveTldFinder

  Show description for 39fdd57
  sebastian-nagel

  committed
  39fdd57

  Copy full SHA for 39fdd57

• WARC writer: attach metadata record also to revisit records, fixes #33

  sebastian-nagel

  committed
  d2e4efc

  Copy full SHA for d2e4efc

• Fetcher: add counter to count IP address versions

  sebastian-nagel

  committed
  8d0b855

  Copy full SHA for 8d0b855

• NUTCH-3095 Update .gitignore to ignore Hadoop native libraries

  sebastian-nagel

  committed
  aa218b2

  Copy full SHA for aa218b2

• NUTCH-3092 Replace all imports of commons-lang by commons-lang3

  Show description for 9788fc0
  sebastian-nagel

  committed
  9788fc0

  Copy full SHA for 9788fc0

• NUTCH-3092 Replace all imports of commons-lang by commons-lang3

  sebastian-nagel

  committed
  8aa5fae

  Copy full SHA for 8aa5fae

• Upgrade webarchive-commons dependency

  sebastian-nagel

  committed
  ced5706

  Copy full SHA for ced5706

Commits on Nov 21, 2024

• Merge pull request #31 from commoncrawl/cc-github-workflow

  Show description for 826d802
  sebastian-nagel

  authored
  826d802

  Copy full SHA for 826d802

• WARC writer canonicalize IPv6 addresses

  Show description for 54f07cc
  sebastian-nagel

  committed
  54f07cc

  Copy full SHA for 54f07cc

Commits on Oct 29, 2024

• test: add Github workflow to build the branch 'cc'

  sebastian-nagel

  committed
  a16d3cf

  Copy full SHA for a16d3cf

• Merge upstream branch 'master' into cc

  Show description for 9a5a66f
  sebastian-nagel

  committed
  9a5a66f

  Copy full SHA for 9a5a66f

• NUTCH-2771 Tests in nightly builds: skip long runners

  Show description for e1b8dbe
  sebastian-nagel

  committed
  e1b8dbe

  Copy full SHA for e1b8dbe

Commits on Oct 27, 2024

• NUTCH-3084 Improve CI by filtering and separating plugin and core test execution (#833)

  Show description for 5961e26
  lewismc

  authored
  5961e26

  Copy full SHA for 5961e26

Commits on Oct 26, 2024

• NUTCH-3072 Fetcher to stop QueueFeeder if aborting with "hung threads"

  Show description for 55aa43b
  sebastian-nagel

  committed
  55aa43b

  Copy full SHA for 55aa43b

Pagination

Previous

Next