This repository has been archived by the owner on May 12, 2021. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 27
/
CHANGES.txt
219 lines (184 loc) · 12.2 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
Release Notes - MRUnit - Version 1.1.0
** Bug
* [MRUNIT-129] - Key object re-use in Reducer is inconsistent with MapReduce behaviour (new API)
* [MRUNIT-157] - allow null keys and values as output, expected output
* [MRUNIT-185] - IllegalFormatException for '%' in Output
* [MRUNIT-186] - method context.getNumReduceTasks() does not work
* [MRUNIT-188] - Throw assertion error if drivers are reused
* [MRUNIT-189] - MapDriverBase.withInput comments state same as setInput but uses addInput
* [MRUNIT-190] - Use mvn enforcer plugin to ensure that a non-vulnerable version of java is used for javadoc generation
* [MRUNIT-192] - MRUNIT-180 requires values be comparble
* [MRUNIT-193] - Serialization.copy throws NPE instead of ISE (missing serilization impl) for Hadoop 2.x
* [MRUNIT-198] - Serialization is missing in MockMultipleOutputs
* [MRUNIT-199] - Mapper.Context and Reducer.Context are not fully mocked
* [MRUNIT-203] - tarballs should extract to dirs with the same name as tarball
* [MRUNIT-204] - Jira and Wiki tutorial are outdated
* [MRUNIT-209] - Can't use the maven dependency plugin with maven 3 on mrunit (Alexandre Normand via Dave Beech)
* [MRUNIT-208] - mrunit unnecessarily depends on mockito-all (Alexandre Normand via Dave Beech)
* [MRUNIT-207] - Test failure on trunk-hadoop1 branch (Jason E Tedor via Brock Noland)
** Improvement
* [MRUNIT-164] - Remove duplicated InputPathStoringMapper classes
* [MRUNIT-180] - Being able to use a comparator on runTest
* [MRUNIT-182] - TemporaryPath should support test data in subdirectories
* [MRUNIT-194] - Update versions of Hadoop we compile against
** New Feature
* [MRUNIT-13] - Add support for MultipleOutputs
* [MRUNIT-162] - MapReduce testing utilties
* [MRUNIT-205] - Add support for MultipleInputs
Release Notes - MRUnit - Version 1.0.0
** Sub-task
* [MRUNIT-144] - Change repository location on MRunit website
* [MRUNIT-145] - Change repository location on Jenkins
* [MRUNIT-146] - Change repository location in source code
* [MRUNIT-172] - Branch trunk should use hadoop 2
* [MRUNIT-173] - Create instructions on building hadoop1 and hadoop2 source/binary tarball
* [MRUNIT-174] - Remove portions of MRUNIT-161 which don't compile on trunk-hadoop1
* [MRUNIT-176] - Branch trunk-hadoop1 should use hadoop 1
* [MRUNIT-183] - Binary distribution should include only jar with correct classifier
** Bug
* [MRUNIT-105] - testJavaSerialization methods fail in Java 7 because they do not set a group comparator
* [MRUNIT-114] - should support calling configure on sorting and grouping comparators if applicable
* [MRUNIT-115] - set JobConf specific to the inputformat reading the results of the outputformat/copying when not using a real outputformat
* [MRUNIT-116] - Setting of configuration on Mappers/Reducers in MapDriver and ReduceDriver is inconsistent
* [MRUNIT-124] - DistributedCache should move files from getCacheFiles to getLocalCacheFiles
* [MRUNIT-126] - Counter tests are ignored if test is executed using run() rather than runTest()
* [MRUNIT-127] - Key grouping with GroupingComparators is not consistent with MapReduce behaviour
* [MRUNIT-130] - Download page does not point to KEYS; no hashes in download area; must not advertise snapshot builds
* [MRUNIT-131] - Comparators registered using WritableComparator.define are not used during tests
* [MRUNIT-132] - Spelling mistakes in TestReducerInputValueReuse
* [MRUNIT-159] - MRUnit not compiling with hadoop 0.23.3
* [MRUNIT-161] - some distributed cache apis not working - JobContext getCacheArchives()
* [MRUNIT-163] - getTaskAttemptID is missing from context
* [MRUNIT-165] - MapReduceDriver calls Mapper#cleanup for each input instead of once
* [MRUNIT-167] - context passed to an OuputFormatter is ignored by the framework
* [MRUNIT-178] - Remove portions of MRUNIT-167 on trunk-hadoop1 which do not compile
* [MRUNIT-179] - Set mapred.output.dir and mapred.input.dir in trunk
** Dependency upgrade
* [MRUNIT-112] - upgrade hadoop 1 dependency to hadoop-core 1.0.3
* [MRUNIT-113] - upgrade hadoop 2 dependency to 2.0.0-alpha
** Improvement
* [MRUNIT-95] - use Serialization framework to change all set/add input/output methods to serialize, deserialize to do defensive copying
* [MRUNIT-100] - Maven doesn't generate md5/sha1 files automatically
* [MRUNIT-118] - InputSplit should support a configurable filename
* [MRUNIT-119] - Counter tests should support assertions that counters are not present
* [MRUNIT-121] - Configure RAT to ignore IntelliJ IDEA files
* [MRUNIT-122] - Context should be mockable
* [MRUNIT-123] - Driver.runTest should not wrap IOException in RuntimeException
* [MRUNIT-125] - reduce duplicate code related to fluent methods with generics
* [MRUNIT-133] - MapInput stuff should be moved from TestDriver to MapDriver.
* [MRUNIT-136] - PipelineMapReduceDriver needs withAll/addAll methods
* [MRUNIT-137] - Remove duplicated set/add/withOutput methods
* [MRUNIT-138] - Multiple calls to withInput should be supported
* [MRUNIT-142] - withKeyGroupingComparator/withKeyOrderComparator should be in MapReduceDriverBase
* [MRUNIT-158] - withOutput doesn't generate useful information with MapWritable on error
* [MRUNIT-168] - .gitignore does not exist
* [MRUNIT-169] - rat exclude does not list .gitignore
** New Feature
* [MRUNIT-64] - Multiple Input Key, Value Pairs should be supported
* [MRUNIT-98] - DistributedCache support
* [MRUNIT-101] - allow use of real OutputFormats such as TextOutputFormat instead of the MockOutputCollector/MockContextWrapper classes
** Task
* [MRUNIT-104] - move non user classes into internal package
* [MRUNIT-107] - remove unused internal classes: MockOutputCommitter, MockRawKeyValueIterator and mapreduce.MockReporter
* [MRUNIT-108] - copy ExtendedAssert.assertListEquals to src/test/java and deprecate entire class and all methods in ExtendedAssert in src/main/java
* [MRUNIT-110] - remove disclaimer and update links in the pom to new TLP resources
* [MRUNIT-140] - TestDriver should use composition and have less responsilibities
* [MRUNIT-141] - Fix grammatical errors in counter log messages
* [MRUNIT-143] - Handle repository migration to GIT
* [MRUNIT-147] - upgrade parent pom to version 11
* [MRUNIT-149] - bind analyze-only goal from dependency plugin to prepare-package to make sure dependencies are correct
* [MRUNIT-150] - remove unnecessary log4j dependency
Release Notes - MRUnit - Version 0.9.0
** Bug
* [MRUNIT-54] - Driver.runTest throws RuntimeException should it throw AssertionError?
* [MRUNIT-70] - copy(orig, conf) in Serialization shouldn't require objects to have a no-args constructor, and copy(orig, copy, conf) seems to violate contract for deserializer.deserialize()
* [MRUNIT-77] - cannot use serializations that do not clone into object, or serializations without no arg constructors with reduce driver
* [MRUNIT-86] - Configuration not passed to individual mappers/reducers in mapred MapReducerDriver, PipelineMapReduceDriver
* [MRUNIT-97] - InputSplit causes NullPointerException in mapreduce api
* [MRUNIT-99] - dont force K2 in MapReduceDriver's to be Comparable since Hadoop dont enforce this on the map output key and value classes
** Dependency upgrade
* [MRUNIT-90] - upgrade junit to 4.10 and change ExpectedSuppliedException to implement TestRule instead
** Improvement
* [MRUNIT-45] - MockOutputCollector.deepCopy should use o.a.h.mrunit.Serialization.copy
* [MRUNIT-46] - Tests should use *Driver.new*Driver factory methods for cleaner code
* [MRUNIT-48] - Test and Deprecate Driver.{*OutputFromString,*InputFromString} Methods
* [MRUNIT-49] - o.a.h.mrunit.mapreduce.ReduceDriverBase.ValueClassInstanceReuseList Configuration not modifable
* [MRUNIT-62] - Add Maven Profile Build Information to BUILD.txt
* [MRUNIT-65] - return better error message when mapper or reducer is null for MapDriver or ReduceDriver
* [MRUNIT-66] - null input checks and behavior on no input to a driver are inconsistent
* [MRUNIT-72] - MRUnit pom.xml should not depend on 0.23.1-SNAPSHOT
* [MRUNIT-74] - Matching output but at incorrect position is not returned as an Error in the message string thrown in the RuntimeException
* [MRUNIT-75] - cleanup exception checking in tests to use a @Rule ExpectedException
* [MRUNIT-85] - Run java conventions formatter that comes with eclipse on all source code
* [MRUNIT-89] - add static convenience methods to PipelineMapReduceDriver class
* [MRUNIT-91] - runTest() should optionally ignore output order
* [MRUNIT-92] - cleanup multiple release profile and javadoc handling in pom
* [MRUNIT-96] - Cleanup release: remove unnecesssary artifacts from nexus and distribute single binary distribution with 2 build artifacts, 1 for hadoop 1+ and 1 for hadoop 2+
** New Feature
* [MRUNIT-67] - o.a.h.mrunit.mapreduce.MapReduceDriver should support a combiner
* [MRUNIT-68] - Support custom counter checking
** Task
* [MRUNIT-61] - Build separate source and binary tar balls
* [MRUNIT-94] - upgrade parent pom to version 10 and remove info in pom that is inherited from parent
* [MRUNIT-103] - JUnit license not in NOTICE.txt in a binary tarball
Release Notes - MRUnit - Version 0.8.1
** Bug
* [MRUNIT-55] - Hadoop dependency should be 'provided'
* [MRUNIT-56] - 0.8.0 release does not work with Hadoop 0.23
* [MRUNIT-58] - Javadoc for org.apache.hadoop.mrunit Package Ends
* Prematurely
** Improvement
* [MRUNIT-57] - profile for hadoop 1.0.0
** Task
* [MRUNIT-59] - Only assemble tar.gz, not .zip
* [MRUNIT-60] - Remove special characters from classifers
Release Notes - MRUnit - Version 0.8.0
** Sub-task
* [MRUNIT-27] - Remove unused variables/imports
* [MRUNIT-28] - remove generic types compiler warnings
* [MRUNIT-29] - squash warnings for depreciated classes/methods
** Bug
* [MRUNIT-19] - MRunit ReduceDriver does not fully replicate the reducers
* behaviour with reusing pointers over the iterator
** Improvement
* [MRUNIT-14] - Support JobConfigurable and Closable interfaces
* [MRUNIT-15] - runTests() should throw meaningful error messages
* [MRUNIT-18] - Squash all compiler warnings
* [MRUNIT-30] - Methods {add,set}{Input,Output}FromString have poor error
* messages
* [MRUNIT-31] - Support Hadoop 0.22 and 0.23
* [MRUNIT-42] - Push -javadoc.jar and -sources.jar to maven
* [MRUNIT-44] - Remove AllTests classes
* [MRUNIT-47] - Change new ArrayList and new HashMap to List.newArrayList
* and Maps.newHashMap
** New Feature
* [MRUNIT-43] - Driver methods should have static factory methods similar
* to Guava Lists.newArrayList()
** Task
* [MRUNIT-2] - Create a project site
Release Notes - MRUnit - Version 0.5.0
** Bug
* [MRUNIT-6] - Reverse MAPREDUCE-954 in trunk
* [MRUNIT-7] - Remove empty MockMapContext.java file accidentally added
* [MRUNIT-8] - Fix failing testConfiguration tests
* [MRUNIT-9] - Fix failing testDoubleIteration test
* [MRUNIT-10] - Version in pom should contain -incubating per policy
* [MRUNIT-33] - maven assembly fails with no assembly descriptors found
** Improvement
* [MRUNIT-1] - Port build system to Maven
* [MRUNIT-11] - Test output should be redirected to files
* [MRUNIT-17] - Bind maven assembly to package phase
* [MRUNIT-37] - Use maven deploy plugin
** New Feature
* [MRUNIT-3] - Add Apache RAT support to the build
* [MRUNIT-16] - Generate distribution artifacts from maven
** Task
* [MRUNIT-4] - Create README, LICENSE, and other necessary files for independent release
* [MRUNIT-5] - Setup CI builds for MRUnit
* [MRUNIT-20] - Add a KEYS file containing dev pgp keys to the repo
* [MRUNIT-21] - Add the ASF incubator disclaimer to the README
* [MRUNIT-22] - Add build instructions document
* [MRUNIT-23] - Create a CHANGES file
* [MRUNIT-24] - Fix RAT license check failures since adding CHANGES file
* [MRUNIT-25] - Updated BUILD instructions
* [MRUNIT-32] - Add Brock Noland's key to dist/KEYS file