+
Skip to content

dmah42/alexandria

 
 

Repository files navigation

Alexandria.org

  1. Coding Rules
  2. Full text indexes
  3. Hash table

Build instructions with docker

  1. Build docker image
docker build . -t alexandria
  1. Run container
docker container run --name alexandria -v $PWD:/alexandria -it -d alexandria
  1. Attach to container.
docker exec -it alexandria /bin/bash
  1. Navigate to directory
cd /alexandria
  1. Initialize docker
scripts/init-docker.sh
  1. Download and build dependencies.
scripts/download-deps.sh
scripts/build-deps.sh
  1. Configure with cmake and build tests.
mkdir build; cd build; 

## Build with debug symbols
cmake .. -DCMAKE_BUILD_TYPE=Debug
## or build with compiler optimization
cmake .. -DCMAKE_BUILD_TYPE=Release

## build test suite
make -j4 run_tests

## run test suite
./run_tests

How to build manually (not recommended)

  1. Configure the system (Tested on Ubuntu 20.04)
# Will alter your system and install dependencies with apt.
./scripts/install-deps.sh

# Will download and build zlib, aws-lambda-cpp and aws-sdk-cpp will only alter the local directory.
./scripts/build-deps.sh
  1. Build with cmake
mkdir build
cd build

cmake .. -DCMAKE_BUILD_TYPE=Debug
or
cmake .. -DCMAKE_BUILD_TYPE=Release

make -j24
  1. Download test data to local server. To run the test suite you need to install nginx and pre-download all the data: Configure local nginx test data server

  2. Create output directories. Note, this will create a bunch of directories in the /mnt so make sure you don't have anything there.

./scripts/prepare-output-dirs.sh
  1. Run the test suite
cd build
make run_tests -j24
./run_tests

Notes

On nodes with spinning disks we should turn off energy saving:

hdparm -B 255 /dev/sda

Debugging notes

Debugging scraper with gdb:

By default, gdb captures SIGPIPE of a process and pauses it. However, some program ignores SIGPIPE. So, the default behavour of gdb is not desired when debugging those program. To avoid gdb stopping in SIGPIPE, use the folloing command in gdb: handle SIGPIPE nostop noprint pass

About

Full text search engine powering Alexandria.org - the open search engine.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C++ 97.1%
  • Shell 1.9%
  • Other 1.0%
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载