Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hive 1.2.0 hadoop 2.6.0 cassandra 2.1.6 #2

Open
wants to merge 1,714 commits into
base: master
Choose a base branch
from

Conversation

ajaykakkar
Copy link

No description provided.

John Sichi and others added 30 commits December 12, 2011 21:38
(Marek Sapota via John Sichi)

Summary:
Fix the task downloading Ant.

Parallel tests should create directories as needed.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 777

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1213447 13f79535-47bb-0310-9956-ffa450edef68
(Marek Sapota via John Sichi)

Summary:
Forcing Bash on each remote command call.

Force use of Bash shell, so user default shell choice doesn't impact the test
script.

Test Plan: EMPTY

Reviewers: JIRA, jsichi, njain

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 771

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1213460 13f79535-47bb-0310-9956-ffa450edef68
(Marek Sapota via John Sichi)

Summary: Add quotes around bash -c to fix commands using cd.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 801

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1213519 13f79535-47bb-0310-9956-ffa450edef68
(Marek Sapota via John Sichi)

Summary:
Allow multiple ptest runs.

Allow running ptest simultaneously, multiple times by one person on the same
machines.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: mareksapotafb, jsichi

Differential Revision: 783

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1213525 13f79535-47bb-0310-9956-ffa450edef68
…ff-based

tests
(Marek Sapota via John Sichi)

Summary:
Replace diff -I with regex masking in Java

The current diff -I approach has two problems:  (1) it does not allow resolution
finer than line-level, so it's impossible to mask out pattern occurrences within
a line, and (2) it produces unmasked files, so if you run diff on the command
line to compare the result .q.out with the checked-in file, you see the noise.

My suggestion is to first run sed to replace noise patterns with an
unlikely-to-occur string like ZYZZYZVA, and then diff the pre-masked files
without using any -I.

This would require a one-time hit to update all existing .q.out files so that
they would contain the pre-masked results.

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 597



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214011 13f79535-47bb-0310-9956-ffa450edef68
(Kevin Wilfong via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214380 13f79535-47bb-0310-9956-ffa450edef68
…exists

(Chinna Rao Lalam via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214592 13f79535-47bb-0310-9956-ffa450edef68
index is table based (Kevin Wilfong via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214622 13f79535-47bb-0310-9956-ffa450edef68
…queries (Prasad Mujumdar via cws)

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214636 13f79535-47bb-0310-9956-ffa450edef68
…uld be

changed
(Namit Jain via Yongqiang He)

Summary:
HIVE-2651

It should be called hive.exec.mode.local.auto.input.files.max instead.
The number of input files are checked currently.

Test Plan: EMPTY

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang

Differential Revision: 861

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214647 13f79535-47bb-0310-9956-ffa450edef68
…ist or

          else folder creation fails (Chinna Rao Lalam via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214891 13f79535-47bb-0310-9956-ffa450edef68
…hive-cli

POM does not depend on it either
(Carl Steinbach via John Sichi)

Summary: Make hive-cli and hive-ql depend on hive-builtins

Test Plan: EMPTY

Reviewers: JIRA, jsichi

Reviewed By: jsichi

CC: jsichi

Differential Revision: 897

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1214961 13f79535-47bb-0310-9956-ffa450edef68
mode (Ramkumar Vadali via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1215226 13f79535-47bb-0310-9956-ffa450edef68
          exists (Chinna Rao Lalam via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1220596 13f79535-47bb-0310-9956-ffa450edef68
(Kevin Wilfong via Yongqiang He)

Summary:
Resource files are now added to the class path as soon as they are added via the
CLI.  This fixes the stack overflow error mentioned in the JIRA by ensuring a
consistent class loader between serializers and deserializers for the same
query.

Note that now serdes which contain a static block to register themselves are now
registered twice, once when adding the file to the class loader, and once when
an instance of the class is created.  Previously, registering a serde twice
resulted in an exception, to avoid this, I have downgraded it to a warning.

When a custom UDF is used as part of a join which is converted to a map join,
the XMLEncoder enters an infinite loop when serializing the map reduce task for
the second time, as part of sending it to be executed.  This results in a stack
overflow error.

Test Plan:
I ran the unit tests to verify nothing was broken.

I ran several queries which used custom UDFs and involved a join which was
converted to a map join.  I verified these completed successfully consistently

Reviewers: JIRA, heyongqiang

Reviewed By: heyongqiang

CC: heyongqiang, kevinwilfong

Differential Revision: 957

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1221830 13f79535-47bb-0310-9956-ffa450edef68
…non-secure mode (Ashutosh Chauhan)

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1225683 13f79535-47bb-0310-9956-ffa450edef68
… keys to be run on the same reducer. (Kevin via He Yongqiang)

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1226903 13f79535-47bb-0310-9956-ffa450edef68
…tting

double url encoded (He Yongqiang via namit)



git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1227151 13f79535-47bb-0310-9956-ffa450edef68
…. (Thomas Weise via amareshwari)

git-svn-id: https://svn.apache.org/repos/asf/hive/trunk@1229510 13f79535-47bb-0310-9956-ffa450edef68
dvasilen and others added 30 commits September 23, 2013 09:49
 - correct hadoop (0.22.0)
 - remove finntech repository
 - cassandra-1.2.10
…suffix)

 ref: http://www.dns-sd.org/TrailingDotsInDomainNames.html

I'm not entirely sure this is required for all installations.
Test by grepping for "Choosing data-local task" in hadoop-xxx-jobtracker.log
 to see if jobtracker hostnames are matching split location hostnames.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants