LBRYCommunity/lbrycrd
1
0
Fork 0
Code Issues 29 Pull requests 1 Projects Releases 32 Packages Wiki Activity
lbrycrd/reproducible_build.sh

443 lines
13 KiB
Bash
Raw Normal View History

Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
#!/bin/bash
set -euo pipefail
function HELP {
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
echo "Build lbrycrd"
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
echo "-----"
echo "When run without any arguments, this script expects the current directory"
echo "to be the lbrycrd repo and it builds what is in that directory"
echo
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
echo "This is a long build process so it can be split into two parts"
echo "Specify the -d flag to build only the dependencies"
echo "and the -l flag to build only lbrycrd. This will fail"
echo "if the dependencies weren't built earlier"
echo
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
echo "Optional arguments:"
echo
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
echo "-f: check formatting of committed code relative to master"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
echo "-r: remove intermediate files."
echo "-l: build only lbrycrd"
echo "-d: build only the dependencies"
Change build timeout to 40 minutes
2016-08-08 17:58:58 +02:00
echo "-o: timeout build after 40 minutes"
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
echo "-t: turn trace on"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
echo "-h: show help"
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
exit 1
}
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
CLEAN=false
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
CHECK_CODE_FORMAT=false
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
BUILD_DEPENDENCIES=true
BUILD_LBRYCRD=true
TIMEOUT=false
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
THREE_MB=3145728
travis fix: only output last 1000 lines on error
2016-08-08 17:02:46 +02:00
# this flag gets set to False if
# the script exits due to a timeout
OUTPUT_LOG=true
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
while getopts :crfldoth:w:d: FLAG; do
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
case $FLAG in
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
r)
CLEAN=true
;;
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
f)
CHECK_CODE_FORMAT=true
;;
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
l)
BUILD_DEPENDENCIES=false
;;
d)
BUILD_LBRYCRD=false
;;
o)
TIMEOUT=true
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
;;
t)
set -o xtrace
;;
h)
HELP
;;
\?) #unrecognized option - show help
echo "Option -$OPTARG not allowed."
HELP
;;
:)
echo "Option -$OPTARG requires an argument."
HELP
;;
esac
done
shift $((OPTIND-1))
SUDO=''
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if (( EUID != 0 )); then
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
SUDO='sudo'
fi
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
if [ "$(basename "$PWD")" != "lbrycrd" ]; then
echo "Not currently in the lbrycrd directory. Cowardly refusing to go forward"
exit 1
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
fi
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
SOURCE_DIR=$PWD
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if [ -z "${TRAVIS_OS_NAME+x}" ]; then
if [ "$(uname -s)" = "Darwin" ]; then
OS_NAME="osx"
else
OS_NAME="linux"
fi
else
OS_NAME="${TRAVIS_OS_NAME}"
fi
if [ -z "${TRAVIS_BUILD_DIR+x}" ]; then
START_TIME_FILE="$PWD/start_time"
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
else
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
# if we are on travis (the primary use case for setting a timeout)
# this file is created when the build starts
START_TIME_FILE="$TRAVIS_BUILD_DIR/start_time"
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
fi
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
rm -f ${START_TIME_FILE}
date +%s > ${START_TIME_FILE}
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
NEXT_TIME=60
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
function exit_at_60() {
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if [ -f "${START_TIME_FILE}" ]; then
NOW=$(date +%s)
START=$(cat "${START_TIME_FILE}")
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
TIMEOUT_SECS=3600 # 60 * 60
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
TIME=$((NOW - START))
if (( TIME > NEXT_TIME )); then
echo "Build has taken $((TIME / 60)) minutes: $1"
NEXT_TIME=$((TIME + 60))
fi
if [ "$TIMEOUT" = true ] && (( TIME > TIMEOUT_SECS )); then
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
echo 'Exiting at 60 minutes to allow the cache to populate'
travis fix: only output last 1000 lines on error
2016-08-08 17:02:46 +02:00
OUTPUT_LOG=false
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
exit 1
fi
fi
}
# two arguments
# - pid (probably from $!)
# - echo message
function wait_and_echo() {
PID=$1
TIME=0
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
SLEEP=3
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
# loop until the process is no longer running
# check every $SLEEP seconds, echoing a message every minute
while (ps -p "${PID}" > /dev/null); do
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
exit_at_60 "$2"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
sleep "${SLEEP}"
done
}
# run a command ($1) in the background
# logging its stdout and stderr to $2
# and wait until it completed
function background() {
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
eval $1 >> "$2" 2>&1 &
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
BACKGROUND_PID=$!
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
(
set +xe # do not echo each sleep call in trace mode
wait_and_echo $BACKGROUND_PID "$3"
)
wait $BACKGROUND_PID
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
}
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
function cleanup() {
rv=$?
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
if [ $rv -eq 0 ]; then
return $rv
fi
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
# cat the log file if it exists
travis fix: only output last 1000 lines on error
2016-08-08 17:02:46 +02:00
if [ -f "$2" ] && [ "${OUTPUT_LOG}" = true ]; then
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
echo
echo "Output of log file $2"
echo
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
tail -n 200 "$2"
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
echo
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
fi
# delete the build directory
rm -rf "$1"
echo "Build failed. Removing $1"
exit $rv
}
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
function cat_and_exit() {
rv=$?
# cat the log file if it exists
travis fix: only output last 1000 lines on error
2016-08-08 17:02:46 +02:00
if [ -f "$1" ] && [ "${OUTPUT_LOG}" = true ]; then
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
echo
echo "Output of log file $1"
echo
travis fix: only output last 1000 lines on error
2016-08-08 17:02:46 +02:00
# This used to be the last 3MB but outputing that
# caused problems on travis.
# Hopefully the last 1000 lines is enough
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
# to debug whatever went wrong
travis fix: only output last 1000 lines on error
2016-08-08 17:02:46 +02:00
tail -n 1000 "$1"
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
echo
fi
exit $rv
}
only brew if not already installed Sometimes brew only warns, but other times it errors if you're installing something that is already installed, so lets be safe and only brew if its not already installed
2016-07-15 23:05:30 +02:00
function brew_if_not_installed() {
if ! brew ls | grep $1 --quiet; then
brew install $1
fi
}
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
function install_brew_packages() {
brew update > /dev/null
OSX Travis fix
2018-06-26 19:15:24 +02:00
brew unlink python
only brew if not already installed Sometimes brew only warns, but other times it errors if you're installing something that is already installed, so lets be safe and only brew if its not already installed
2016-07-15 23:05:30 +02:00
brew_if_not_installed autoconf
brew_if_not_installed automake
misc fixes
2016-07-16 03:59:20 +02:00
# something weird happened where glibtoolize was failing to find
# sed, and reinstalling fixes it.
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
brew reinstall libtool
only brew if not already installed Sometimes brew only warns, but other times it errors if you're installing something that is already installed, so lets be safe and only brew if its not already installed
2016-07-15 23:05:30 +02:00
brew_if_not_installed pkg-config
brew_if_not_installed protobuf
brew_if_not_installed gmp
install clang-format for osx, do not add remote origin2 if it already exists for clang formatting check in reproducible_build.sh
2018-07-09 18:52:23 +02:00
if [ "${CHECK_CODE_FORMAT}" = true ]; then
brew_if_not_installed clang-format
fi
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
}
function install_apt_packages() {
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
if [ -d "${OUTPUT_DIR}" ]; then
return 0
fi
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if [ -z "${TRAVIS+x}" ]; then
# if not on travis, its nice to see progress
QUIET=""
else
QUIET="-qq"
fi
# get the required OS packages
$SUDO apt-get ${QUIET} update
$SUDO apt-get ${QUIET} install -y --no-install-recommends \
build-essential python-dev libbz2-dev libtool \
autotools-dev autoconf git pkg-config wget \
ca-certificates automake bsdmainutils
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
if [ "${CHECK_CODE_FORMAT}" = true ]; then
$SUDO apt-get ${QUIET} install -y --no-install-recommends \
repair failed format, bump travis images build experiment 2 build experiment 3 build experiment 4 Replace flattenTrie by callback Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Use interruption point instead of boolean condition Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Add ability to earlier exit in rpc methods getclaimtrie and getclaimsintrie Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> simplified early exit handling ran formatter check out the whole repo on Travis (for formatter) origin should be there
2018-12-14 11:06:10 +01:00
clang-format-3.9
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
fi
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
}
function build_dependencies() {
if [ "${OS_NAME}" = "osx" ]; then
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
PARALLEL="-j $(sysctl -n hw.ncpu)"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
install_brew_packages
else
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
PARALLEL="-j $(grep -c processor /proc/cpuinfo)"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
install_apt_packages
fi
Fix openssl build on 32 bit Linux Signed-off-by: Anthony Fieroni <bvbfan@abv.bg>
2018-05-25 07:07:15 +02:00
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if [ "$CLEAN" = true ]; then
rm -rf "${LBRYCRD_DEPENDENCIES}"
rm -rf "${OUTPUT_DIR}"
fi
download dependencies from lbrycrd-dependencies repo
2016-07-13 01:11:14 +02:00
if [ ! -d "${LBRYCRD_DEPENDENCIES}" ]; then
git clone https://github.com/lbryio/lbrycrd-dependencies.git "${LBRYCRD_DEPENDENCIES}"
fi
misc fixes
2016-07-16 03:59:20 +02:00
# TODO: if the repo exists, make sure its clean: revert to head.
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
mkdir -p "${LOG_DIR}"
build_dependency "${OPENSSL_PREFIX}" "${LOG_DIR}/openssl_build.log" build_openssl
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
build_dependency "${ICU_PREFIX}" "${LOG_DIR}/icu_build.log" build_icu
build_dependency "${BDB_PREFIX}" "${LOG_DIR}/bdb_build.log" build_bdb
Fix openssl build on 32 bit Linux Signed-off-by: Anthony Fieroni <bvbfan@abv.bg>
2018-05-25 07:07:15 +02:00
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
set +u
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
export PKG_CONFIG_PATH="${PKG_CONFIG_PATH}:${OPENSSL_PREFIX}/lib/pkgconfig"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
set -u
build_dependency "${BOOST_PREFIX}" "${LOG_DIR}/boost_build.log" build_boost
build_dependency "${LIBEVENT_PREFIX}" "${LOG_DIR}/libevent_build.log" build_libevent
}
function build_bdb() {
BDB_LOG="$1"
if [ "${OS_NAME}" = "osx" ]; then
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
# TODO: make this handle already patched files
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
patch db-4.8.30.NC/dbinc/atomic.h < atomic.patch
fi
cd db-4.8.30.NC/build_unix
echo "Building bdb. tail -f $BDB_LOG to see the details and monitor progress"
../dist/configure --prefix="${BDB_PREFIX}" --enable-cxx --disable-shared --with-pic > "${BDB_LOG}"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
background "make ${PARALLEL}" "${BDB_LOG}" "Waiting for bdb to finish building"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
make install >> "${BDB_LOG}" 2>&1
}
function build_openssl() {
OPENSSL_LOG="$1"
mkdir -p "${OPENSSL_PREFIX}/ssl"
cd openssl-1.0.1p
echo "Building openssl. tail -f $OPENSSL_LOG to see the details and monitor progress"
if [ "${OS_NAME}" = "osx" ]; then
./Configure --prefix="${OPENSSL_PREFIX}" --openssldir="${OPENSSL_PREFIX}/ssl" \
-fPIC darwin64-x86_64-cc \
no-shared no-dso no-engines > "${OPENSSL_LOG}"
else
Fix openssl build on 32 bit Linux Signed-off-by: Anthony Fieroni <bvbfan@abv.bg>
2018-05-25 07:07:15 +02:00
[[ $(uname -m) = 'i686' ]] && OS_ARCH="linux-generic32" || OS_ARCH="linux-x86_64"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
./Configure --prefix="${OPENSSL_PREFIX}" --openssldir="${OPENSSL_PREFIX}/ssl" \
Fix openssl build on 32 bit Linux Signed-off-by: Anthony Fieroni <bvbfan@abv.bg>
2018-05-25 07:07:15 +02:00
${OS_ARCH} -fPIC -static no-shared no-dso > "${OPENSSL_LOG}"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
fi
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
background "make ${PARALLEL}" "${OPENSSL_LOG}" "Waiting for openssl to finish building"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
make install >> "${OPENSSL_LOG}" 2>&1
}
function build_boost() {
BOOST_LOG="$1"
cd boost_1_59_0
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
echo "int main() { return 0; }" > libs/regex/build/has_icu_test.cpp
echo "int main() { return 0; }" > libs/locale/build/has_icu_test.cpp
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
export BOOST_ICU_LIBS="-L${ICU_PREFIX}/lib -licui18n -licuuc -licudata -dl"
export BOOST_LDFLAGS="-L${BOOST_PREFIX}/lib ${BOOST_ICU_LIBS}"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
echo "BOOST_LDFLAGS: $BOOST_LDFLAGS"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
echo "Building Boost. tail -f ${BOOST_LOG} to see the details and monitor progress"
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
./bootstrap.sh --prefix="${BOOST_PREFIX}" --with-icu="${ICU_PREFIX}" > "${BOOST_LOG}" 2>&1
b2cmd="./b2 --reconfigure ${PARALLEL} link=static cxxflags=-fPIC install boost.locale.iconv=off boost.locale.posix=off -sICU_PATH=\"${ICU_PREFIX}\" -sICU_LINK=\"${BOOST_ICU_LIBS}\""
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
background "${b2cmd}" "${BOOST_LOG}" "Waiting for boost to finish building"
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
if grep -q "icu[[:space:]]*:[[:space:]]*no$" "${BOOST_LOG}"; then
echo "Failed to find ICU dependencies. Exiting..."
exit 1
fi
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
}
function build_icu() {
ICU_LOG="$1"
mkdir -p "${ICU_PREFIX}/icu"
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
wget -c http://download.icu-project.org/files/icu4c/57.1/icu4c-57_1-src.tgz
tar -xf icu4c-57_1-src.tgz
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
pushd icu/source > /dev/null
echo "Building icu. tail -f $ICU_LOG to see the details and monitor progress"
./configure --prefix="${ICU_PREFIX}" --enable-draft --enable-tools \
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
--disable-shared --enable-static --disable-extras --disable-icuio --disable-dyload \
--disable-layout --disable-layoutex --disable-tests --disable-samples CFLAGS=-fPIC CPPFLAGS=-fPIC > "${ICU_LOG}"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
if [ ! -z ${TARGET+x} ]; then
TMP_TARGET="${TARGET}"
unset TARGET
fi
set +e
background "make ${PARALLEL} VERBOSE=1" "${ICU_LOG}" "Waiting for icu to finish building"
make install >> "${ICU_LOG}" 2>&1
if [ ! -z ${TARGET+x} ]; then
TARGET="${TMP_TARGET}"
fi
set -e
popd > /dev/null
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
}
function build_libevent() {
LIBEVENT_LOG="$1"
misc fixes
2016-07-16 03:59:20 +02:00
if [ ! -d libevent ]; then
use specific version 2.0.22 stable of libevent in reproducible builds
2018-04-11 21:42:54 +02:00
git clone --branch release-2.0.22-stable https://github.com/libevent/libevent.git
misc fixes
2016-07-16 03:59:20 +02:00
fi
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
cd libevent
echo "Building libevent. tail -f ${LIBEVENT_LOG} to see the details and monitor progress"
./autogen.sh > "${LIBEVENT_LOG}" 2>&1
./configure --prefix="${LIBEVENT_PREFIX}" --enable-static --disable-shared --with-pic \
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
LDFLAGS="-L${OPENSSL_PREFIX}/lib" \
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
CPPFLAGS="-I${OPENSSL_PREFIX}/include" >> "${LIBEVENT_LOG}" 2>&1
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
background "make ${PARALLEL}" "${LIBEVENT_LOG}" "Waiting for libevent to finish building"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
make install >> "${LIBEVENT_LOG}"
}
function build_dependency() {
repair failed format, bump travis images build experiment 2 build experiment 3 build experiment 4 Replace flattenTrie by callback Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Use interruption point instead of boolean condition Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Add ability to earlier exit in rpc methods getclaimtrie and getclaimsintrie Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> simplified early exit handling ran formatter check out the whole repo on Travis (for formatter) origin should be there
2018-12-14 11:06:10 +01:00
pushd .
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
PREFIX=$1
LOG=$2
BUILD=$3
if [ ! -d "${PREFIX}" ]; then
trap 'cleanup "${PREFIX}" "${LOG}"' INT TERM EXIT
cd "${LBRYCRD_DEPENDENCIES}"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
rm -rf ${PREFIX}
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
mkdir -p "${PREFIX}"
"${BUILD}" "${LOG}"
trap - INT TERM EXIT
fi
repair failed format, bump travis images build experiment 2 build experiment 3 build experiment 4 Replace flattenTrie by callback Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Use interruption point instead of boolean condition Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Add ability to earlier exit in rpc methods getclaimtrie and getclaimsintrie Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> simplified early exit handling ran formatter check out the whole repo on Travis (for formatter) origin should be there
2018-12-14 11:06:10 +01:00
popd
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
}
function build_lbrycrd() {
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
cd "${SOURCE_DIR}"
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
./autogen.sh > "${LBRYCRD_LOG}" 2>&1
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
LDFLAGS="-L${OPENSSL_PREFIX}/lib -L${BDB_PREFIX}/lib -L${LIBEVENT_PREFIX}/lib -L${ICU_PREFIX}/lib -static-libstdc++ -licui18n -licuuc -licudata -dl"
OPTIONS="--enable-cxx --enable-static --disable-shared --with-pic"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if [ "${OS_NAME}" = "osx" ]; then
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
CPPFLAGS="-I${OPENSSL_PREFIX}/include -I${BDB_PREFIX}/include -I${LIBEVENT_PREFIX}/include -I${ICU_PREFIX}/include"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
else
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
CPPFLAGS="-I${OPENSSL_PREFIX}/include -I${BDB_PREFIX}/include -I${LIBEVENT_PREFIX}/include -I${ICU_PREFIX}/include -Wno-unused-local-typedefs -Wno-deprecated -Wno-implicit-fallthrough"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
fi
CPPFLAGS="${CPPFLAGS}" LDFLAGS="${LDFLAGS}" \
./configure --without-gui ${OPTIONS} \
--with-boost="${BOOST_PREFIX}" \
--with-icu="${ICU_PREFIX}" >> "${LBRYCRD_LOG}" 2>&1
background "make ${PARALLEL}" "${LBRYCRD_LOG}" "Waiting for lbrycrd to finish building"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
}
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
function clang_format_diff(){
# run a code formatting check on any commits not in master
# requires clang-format
repair failed format, bump travis images build experiment 2 build experiment 3 build experiment 4 Replace flattenTrie by callback Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Use interruption point instead of boolean condition Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> Add ability to earlier exit in rpc methods getclaimtrie and getclaimsintrie Signed-off-by: Anthony Fieroni <bvbfan@abv.bg> simplified early exit handling ran formatter check out the whole repo on Travis (for formatter) origin should be there
2018-12-14 11:06:10 +01:00
git diff -U0 origin/master -- '*.h' '*.cpp' | ./contrib/devtools/clang-format-diff.py -p1
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
}
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
# these variables are needed in both functions
LBRYCRD_DEPENDENCIES="$(pwd)/lbrycrd-dependencies"
OUTPUT_DIR="$(pwd)/build"
LOG_DIR="$(pwd)/logs"
Implement a hard fork to normalize claim names Apply (self) review feedback Clean deps required for boost to rebuild with icu support (for now) Normalization bug fixes and improvements Clang-formatting
2018-06-28 04:12:41 +02:00
ICU_PREFIX="${OUTPUT_DIR}/icu"
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
BDB_PREFIX="${OUTPUT_DIR}/bdb"
OPENSSL_PREFIX="${OUTPUT_DIR}/openssl"
BOOST_PREFIX="${OUTPUT_DIR}/boost"
LIBEVENT_PREFIX="${OUTPUT_DIR}/libevent"
if [ "${BUILD_DEPENDENCIES}" = true ]; then
build_dependencies
fi
add libevent
2016-06-08 03:25:24 +02:00
Add option to peform clang formatting check on reproducible_build.sh, run it in travis. Adjust README contributing guidelines.
2018-06-20 23:34:56 +02:00
if [ "${CHECK_CODE_FORMAT}" = true ]; then
LINES_W_FORMAT_REQUIRED=$(clang_format_diff | wc -l)
if [ ${LINES_W_FORMAT_REQUIRED} -ne 0 ]; then
echo "Failed to pass clang format diff: See below for the diff"
clang_format_diff
exit 1
fi
fi
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
set +u
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
export PKG_CONFIG_PATH="${PKG_CONFIG_PATH}:${OPENSSL_PREFIX}/lib/pkgconfig:${LIBEVENT_PREFIX}/lib/pkgconfig:${ICU_PREFIX}/lib/pkgconfig"
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
set -u
Add osx build to travis This is a large commit. Travis has some limitations that the OSX build runs into so a few things needed to change: - travis has a 4mb log limit - log stdout/stderr to log files - cat relevant log file if there is a build issue - travis will kill the job if it is silent for ten minutes - echo messages every minute - travis has a 50 minute job limit - add caching for dependencies - proactively abort a build after 45 minutes to ensure the cache will be populated Caching creates its own set of problems so the ability to clear the dependency folder was added and each dependency will delete its folder if something goes wrong during the build of that dependency. This prevents future runs from thinking a dependency has been cached when it actually hasn't. The build files for OSX and linux were unified into one script.
2016-07-01 16:37:13 +02:00
if [ "${BUILD_LBRYCRD}" = true ]; then
LBRYCRD_LOG="${LOG_DIR}/lbrycrd_build.log"
echo "Building lbrycrd. tail -f ${LBRYCRD_LOG} to see the details and monitor progress"
output log file when lbrycrd build fails
2016-07-16 02:13:53 +02:00
trap 'cat_and_exit "${LBRYCRD_LOG}"' INT TERM EXIT
build_lbrycrd
trap - INT TERM EXIT
removed duplicate trie in RAM, other norm fixes also includes code to validate incoming utf8 moved normalization from claimTrie; all in cache now also fixed a few post-merge issues added handling for support normalization fixed failure to handle unnormalized items reinserted on rollback fixing ICU deps for Travis build get more info on Travis build failure Travis experiment 2: ICU fPIC add independent tests to check string normalization only move comment to proper location, and note what excpetion is thrown add RPC call checknormalization so user can see what normalization does made expiration at norm time smarter also rearranged unit test code to avoid some spurious errors made ICU compile statically also fixed early exit in reproducible_build script changed to keep original name removed ability to return just-added supports it was impossible to get the normalized names correct there apparently the -s is no longer appreciated moved normalization code to separate file also fixed bug on effective amount fixed performance problem on trie upgrade fixed issue with valid height on rollback fixed issue with post-normalization name q data fixed failure to remove normalized claims on rollback post-merge fixes post-merge fixes
2018-12-14 23:21:52 +01:00
./src/test/test_lbrycrd
set +u
if [[ ! $CXXFLAGS =~ -g ]]; then
strip src/lbrycrdd
strip src/lbrycrd-cli
strip src/lbrycrd-tx
fi
Modify reproducible build script - fixes type on last line - works on a fresh ubuntu docker container - will hopefully work on travis too
2016-07-01 08:02:29 +02:00
fi
Reference in a new issue Copy permalink