Apache Bigtop 1.4.0 release, big data package testing tools

by ·

Apache Bigtop is an open source project for infrastructure engineers and data scientists designed to fully package, test, and deploy leading open source big data components/projects, including but not limited to Hadoop, HBase, and Spark. Support for Debian, Ubuntu, CentOS, Fedora, openSUSE and other operating systems.

  • Packaging – packages Hadoop RPMs and DEBs, so that you can manage and maintain your Hadoop cluster
  • Smoke testing – provides an integrated smoke testing framework, alongside a suite of over 50 test files
  • Virtualization – provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero

Apache Bigtop 1.4.0 has been released.

Changelog

Bug

  • [BIGTOP-2595] – Make Spark1 and Spark2 coexist
  • [BIGTOP-2892] – The download page should provide instructions to check hashes and signatures
  • [BIGTOP-2986] – Oozie build is failing
  • [BIGTOP-3099] – Fix oozie build
  • [BIGTOP-3102] – docker-hadoop.sh WARNING: The scale command is deprecated
  • [BIGTOP-3107] – QFS cannot compile with newer Oracle SDK
  • [BIGTOP-3112] – Update release KEYS file from dist.apache.org to apache.org/dist
  • [BIGTOP-3113] – Update previous releases links to the archive.apache.org in the download page
  • [BIGTOP-3125] – [provisioner] sbin/init is missed in puppet:opensuse-42.3
  • [BIGTOP-3151] – Add flink smoke test
  • [BIGTOP-3184] – URLConnection check fails with exception when it should return false
  • [BIGTOP-3194] – Phoneix QueryServer PID file name in svc file is inconsistent with that in QueryServer’s execution script

New Feature

  • [BIGTOP-2947] – Project Frontier: Bigtop Integration Test Framework 2.0

Improvement

  • [BIGTOP-1227] – Deploy artifacts to maven repository
  • [BIGTOP-3085] – Hello world example for adding a new package
  • [BIGTOP-3135] – Remove deprecated giraph-site.xml
  • [BIGTOP-3152] – No need to Force the use of Netty over Hadoop RPC in Giraph
  • [BIGTOP-3204] – Upgrade flink from 1.4.2 to 1.6.0 or higher

Task

  • [BIGTOP-3098] – Update maven plugins for project pom
  • [BIGTOP-3105] – Sync up site changes from branch 1.3 to master
  • [BIGTOP-3106] – Update links in download page
  • [BIGTOP-3108] – Update version strings to 1.3.0 in the master
  • [BIGTOP-3109] – Overhaul the deployment and testing modules
  • [BIGTOP-3128] – Switch to new gitbox repository
  • [BIGTOP-3162] – Define Bigtop 1.4.0 release BOM
  • [BIGTOP-3178] – Fix two insecure maven repositories

Download

Tags: