BEEHIVE RAID Mac OS
How To: Install Mac OS High Sierra 10.13 – RAID 0 Configuration RAID 0 is a popular disk setup solution to achieve the fastest possible read and write disk speeds by splitting data between two or more hard drives. The latest version of Mac OS X High Sierra (10.13) does not allow you to simply install to any kind of RAID configuration. RAID 1 uses two hard drives and doesn’t come with the speed advantage of RAID 0. This is similar to RAID 0 in that all you need is a couple hard drives and the RAID function in Disk Utility. RAID 10: This is a combination of RAID 1 and RAID 0. It requires four hard drives to use, and is essentially two RAID 0 sets mirroring each other.
Setup Hive on Mac
This tutorial will provide step by step instruction to setup Hive on Mac OS.
Download Apache HiveYou can click here to download apache Hive 3.0.0 version or go to Apache site http://www-eu.apache.org/dist/hive/ to download directly from there.Move the downloaded Hive binary to below path & extract it.
Beehive Raid Mac Os X
There are 7 steps to complete in order run Hive
- HDFS (Hadoop) setup should be present, if not present then please complete hadoop setup first. Steps available on Hadoop Setup
- Setup environment variables in .profile file
- Hive need external database to store Hive Metadata called Metastore. Setup either mysql or Derby database for Hive Metastore.
- Download MySql connector jar and place it in Hive library.
- Setup configuration files for local Hive
- Setup HDFS for storing Hive data
- Starting Hive
- Validating hadoop: Hadoop version can be checked using below command.
- Set below Hive & mysql variables in the .profile file in $HOME directory
- Setup Hive Metastore: Mysql, oracle or Derby databases can be used for Hive metastore. Generally it is suggested to use Mysql over Derby. Derby is inbuilt with Hive but with this, you can create only single Hive session.
- Mysql Setup: Mysql can be downloaded from this mysql site link. After downloading & installing mysql server, please follow below steps to start mysql server.
- Go to system preference and click on Dolphin like MySql icon as shown in figure below.
- Next window will have button 'Start MySql Server' to start server. Also ensure that checkbox 'Start MySql when your computer starts up'. Move to next step if it is already started.
- Add the below command in .profile file in home directory
- By default, there is no password for root user of mysql. We need to login root user & create new hive user to be used by Hive & spark.Login to MySql root user and execute below commands
- Go to system preference and click on Dolphin like MySql icon as shown in figure below.
- Derby Setup: Derby is inbuilt and can be setup by running below commands.
If you get below error after running above script
Then search NUCLEUS_ASCII & NUCLEUS_MATCH function in below metadata load file and comment them using double hyphen(--).
- Mysql Setup: Mysql can be downloaded from this mysql site link. After downloading & installing mysql server, please follow below steps to start mysql server.
- MySql Connector: Click here Download MySql connector or directly download from MySql site and extract it.Place the jar file at the following location.
- Setting up configuration files for Hive binary.
- hive-config.sh: Add below command in $HIVE_HOME/bin/hive-config.sh file.
- hive-site.xml (Mysql as Metastore) : Please create hive-site.xml file with below properties under $HOME/hadoop/apache-hive-3.0.0-bin/conf/ directory
- hive-site.xml (Derby as Metastore) : Please replace below property with MySql properties in the above hive-site.xml site.
- hive-config.sh: Add below command in $HIVE_HOME/bin/hive-config.sh file.
- Setup HDFS (creating directory) for storing Hive data & temporary data
- Starting Hive: Hive can be started with 'hive' command and hive shell will open
If hive is able to connect to MySql metastore then above command will work else it will fail with below error
Start hive console again with below command & again run show database commandNote: Hive console in above mode will show exact error why Hive is failing.
If you are seeing timezone error like belowThen change the below value in hive-site.xml
RAID 0 is a popular disk setup solution to achieve the fastest possible read and write disk speeds by splitting data between two or more hard drives. The latest version of Mac OS X High Sierra (10.13) does not allow you to simply install to any kind of RAID configuration. This has frustrated a lot of the Mac community. Until Mac OS X High Sierra officially supports RAID configurations, follow the steps below to setup a fully functional RAID 0 configuration.
*You will notbe able to install system updates from the App Store on your live RAID volume. However, see our workaround at the end of guide. *
In order to install the latest version of Mac OS X onto a RAID 0 slice, you must clone a copy of your Mac OS X installation straight to the RAID 0 drives (not a restore, such as Time Machine, which will not work). To accomplish this, you need an external hard drive and a copy of SuperDupersoftware in addition to your RAID 0 drives. We will use the same Mac machine (that will use RAID 0) to perform all the steps below. This method uses hardware RAID and is not a software RAID.
Note: We strongly recommend taking a full backup (Time Machine) to another drive just in case when performing these steps! Save yourself from an accident!
- Use SuperDuper to clone your existing copy of Mac OS to the external drive.If you want to a fresh copy of Mac OS High Sierra instead, clone a copy of a fresh install of High Sierra to the external drive using SuperDuper.
Note: Be sure to complete your SuperDuper clones on the same type of Mac you will install the RAID 0 configuration on. This is important because your Mac OS High Sierra clone will have drivers and system files specific to that machines hardware.
Beehive Raid Mac Os Catalina
- Next, boot from the cloned external drive we created. Plug in the drive and hold down the option key and choose the external drive install media.
- Now that we booted up from our external hard drive, we can manage our Mac’s internal hard drives and create our RAID 0 array. Remember to only create a RAID 0 array with the same model and capacity size drives.
Open Disk Utility in Applications -> Utilities and create your RAID 0 array shown below.
Beehive Raid Mac Os Pro
Go to File -> RAID Assistant
Select Striped (RAID 0)
Select your 2 internal hard drives to create the RAID array from
Name your single RAID drive. For Chunksize, choose a lower size if you will be using the RAID for regular needs (email/browsing/word processing.) For video editing, choose a higher chunk size.
Success screen appears
- Open SuperDuper and copy the external drive to your new RAID 0 drive.
The copy will complete successfully. Finally, go to System Preferences -> Startup Disk and select your new drive and restart. The first restart may take a little time as your boot files load for the first time.
You can confirm your successful RAID 0 in Disk Utility.
If system updates are available in the app store they will appear, but do not attempt to install them. Your computer will fail installing them and you will likely damage your OS installation! App Store Application updates will install OK. See below workaround.
Install Mac OS 10.13 System Updates on RAID drive
- Time Machine backup your current RAID Mac OS System.
- Boot to recovery mode. Destroy your RAID drive configuration and reate 2 separate Mac OS Journaled disks.
- Time machine recover to one of the two disks, boot up, and install updates from App Store.
- After updates are installed, create a new Time Machine Backup.
- Use SuperDuper to create a clone of your Mac OS with installed updates.
- Finally, boot from a different Mac OS High Sierra install disk. Create your RAID configuration and restore (using Disk Utility) or copy (Using SuperDuper) back to your RAID drive configuration.
Now you have the latest Mac OS X system updates installed on your RAID O configuration drive again. The entire process took us under 1 hour using SSD drives and USB 3.0.