– cut here –
package my.package

import java.io.File;
import java.io.UnsupportedEncodingException;
import java.lang.reflect.Modifier;
import java.net.URLDecoder;
import java.util.ArrayList;
import java.util.Collections;
import java.util.Comparator;
import java.util.List;

import org.apache.log4j.Logger;
import org.junit.runners.model.InitializationError;
import org.junit.runner.Description;
import org.junit.runner.RunWith;
import org.junit.runner.notification.RunListener;
import org.junit.runner.notification.RunNotifier;
import org.junit.runners.Suite;

/**
* Discovers all JUnit tests and runs them in a suite.
*/
@RunWith(AllTests.AllTestsRunner.class)
public final class AllTests {

private static final File CLASSES_DIR = findClassesDir();

private AllTests() {
// static only
}

/**
* Finds and runs tests.
*/
public static class AllTestsRunner extends Suite {

private final Logger _log = Logger.getLogger(getClass());

/**
* Constructor.
*
* @param clazz the suite class – AllTests
* @throws InitializationError if there’s a problem
* @throws org.junit.runners.model.InitializationError
*/
public AllTestsRunner(final Class clazz) throws InitializationError {
super(clazz, findClasses());
}

/**
* {@inheritDoc}
* @see org.junit.runners.Suite#run(org.junit.runner.notification.RunNotifier)
*/
@Override
public void run(final RunNotifier notifier) {
initializeBeforeTests();

notifier.addListener(new RunListener() {
@Override
public void testStarted(final Description description) {
if (_log.isTraceEnabled()) {
_log.trace(“Before test ” + description.getDisplayName());
}
}

@Override
public void testFinished(final Description description) {
if (_log.isTraceEnabled()) {
_log.trace(“After test ” + description.getDisplayName());
}
}
});

super.run(notifier);
}

private static Class[] findClasses() {
List classFiles = new ArrayList();
findClasses(classFiles, CLASSES_DIR);
List<Class> classes = convertToClasses(classFiles, CLASSES_DIR);
return classes.toArray(new Class[classes.size()]);
}

private static void initializeBeforeTests() {
// do one-time initialization here
}

private static List<Class> convertToClasses(
final List classFiles, final File classesDir) {

List<Class> classes = new ArrayList<Class>();
for (File file : classFiles) {
if (!file.getName().endsWith(“Test.class”)) {
continue;
}
String name = file.getPath().substring(classesDir.getPath().length() + 1)
.replace(‘/’, ‘.’)
.replace(‘\\’, ‘.’);
name = name.substring(0, name.length() – 6);
Class c;
try {
c = Class.forName(name);
}
catch (ClassNotFoundException e) {
throw new AssertionError(e);
}
if (!Modifier.isAbstract(c.getModifiers())) {
classes.add(c);
}
}

// sort so we have the same order as Ant
Collections.sort(classes, new Comparator<Class>() {
public int compare(final Class c1, final Class c2) {
return c1.getName().compareTo(c2.getName());
}
});

return classes;
}

private static void findClasses(final List classFiles, final File dir) {
for (File file : dir.listFiles()) {
if (file.isDirectory()) {
findClasses(classFiles, file);
}
else if (file.getName().toLowerCase().endsWith(“.class”)) {
classFiles.add(file);
}
}
}
}

private static File findClassesDir() {
try {
String path = AllTests.class.getProtectionDomain()
.getCodeSource().getLocation().getFile();
return new File(URLDecoder.decode(path, “UTF-8″));
}
catch (UnsupportedEncodingException impossible) {
// using default encoding, has to exist
throw new AssertionError(impossible);
}
}
}

– cut here –

Still no luck. I’ve also tested with Eclipse 3.5.1 and it doesn’t work there either. I just left a comment on the Bugzilla entry to see if there’s anything we can do to get this working.

https://bugs.eclipse.org/181508

If you’re really interested in this, you may want to comment on the Bugzilla entry too.

— Patrick

The collector is pretty simple and could easily be extended to organize tests in different ways. There are no output options right now, though.

To run tests in the IDE, you can just run the test suite that extends the bundle test collector. The tests should run normally in the IDE, but make sure you choose Run As -> JUnit Plug-in Test.

I’ve haven’t been able to run any fragment based tests under the ETF either, at least under 3.4. The fragment doesn’t get activated along with the bundle. Haven’t tried it on 3.5 yet. What version are you using?

— Patrick

2 questions:

After creating an AllTests class that extends BundleTestCollector (like shown in the example provided in the zip archive) I cant get it to run as part of my build through ETF but all the tests are shown in a flat list. Can I provide a heirarchy so it is easier to see which tests belong to which package/class?

How can I run directly from the Eclipse IDE?

I still run on the junit4 problem with etf. I checked out etf from cvs. Then I exported the etf feature and it seemed to be valid. Of course before I removed every dependency to org.junit and added org.junit4.
But if i run the test target in build.xml I get the message:
…
core-test:
java-test:
[echo] Running com.rcpquickstart.helloworld.test.collector.AllTests. Result file: E:\WS_AutomatedBuildExample\com.rcpquickstart.helloworld.build-and-test/buildDirectory/test/eclipse/results/com.rcpquickstart.helloworld.test.collector.AllTests.xml.
[java] Java Result: 13
collect-results:
[junitreport] the file E:\WS_AutomatedBuildExample\com.rcpquickstart.helloworld.build-and-test\buildDirectory\test\eclipse\com.rcpquickstart.helloworld.test.collector.AllTests.xml is empty.
[junitreport] This can be caused by the test JVM exiting unexpectedly
[style] Warning: the task name is deprecated. Use instead.
[style] Transforming into E:\WS_AutomatedBuildExample\com.rcpquickstart.helloworld.build-and-test\buildDirectory\test\eclipse\results
collect:
[junitreport] the file E:\WS_AutomatedBuildExample\com.rcpquickstart.helloworld.build-and-test\buildDirectory\test\eclipse\com.rcpquickstart.helloworld.test.collector.AllTests.xml is empty.
[junitreport] This can be caused by the test JVM exiting unexpectedly
…

Even with debugging I couldn’t find out, what exactly the problem is. Maybe since there is no actual build instruction for etf, can you explain more precisely how you made it.

I would appreciate the help.

Martin

no, its surprisingly easy to get this etf running on junit4, just replace all the references in the etf to org.junit with org.junit4. You don´t have to change anything within the SDK (why would you anyway?)

Johannes

I just would like to give a pointer to an alternative test framework to ETF which is called Autotestsuite and is part of Pluginbuilder.

The Autotestsuite collects both JUnit3 and
JUnit4 Test Cases and creates a test suite automatically. JUnit 3
tests are determined by hierarchy (subclasses of TestCase) whereas
JUnit 4 tests are determined by annotations.

The advantage of the autotestsuite is that you neither need to create
All* suites nor add any XML configuration. Every (except ignored JUnit
4) test will be executed without additional tedious configuration. If
you really want to exclude tests, you can do so with regular
expressions. The regular expressions also provide an easy way to
create conventions for your projects, e.g. *UITest* to execute all UI
specific tests.