#26 Integretion Testing Initial Example by JuanJose-Herrera · Pull Request #74 · dapr/java-sdk

JuanJose-Herrera · 2020-01-09T05:36:40Z

… to work on MAC and Linux

Description

Please explain the changes you've made

Issue reference

We strive to have all PR being opened based on an issue, where the problem or feature have been discussed prior to implementation.

Please reference the issue this PR will close: #[issue number]

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

Code compiles correctly
Created/updated tests
Extended the documentation

artursouza

This has potential. Thanks.

artursouza · 2020-01-09T08:34:58Z

+
+    public void initializeDapr() throws IOException, InterruptedException, TimeoutException, ExecutionException {
+
+        File file= new File("../");


No need to use this to depend on current directory location. See my next comment.

I already remove this unneeded file path

artursouza · 2020-01-09T08:39:09Z

+    }
+
+    private static final String DAPR_RUN = "dapr run --app-id %s ";
+    private static final String DAPR_COMMAND = " -- mvn exec:java -pl=sdk -D exec.mainClass=%s -D exec.classpathScope=\"test\"";


You don't actually need to start the app here. You can just start dapr without the service and then start the test app directly in the same JVM (separate thread).

Make DAPR_COMMAND = " -- cat" to just block.
Start a new thread, starting the service: io.dapr.e2e.apps.MyService.main()

I am getting the following error with the cat command, even when that work on my terminal

But using DAPR on windows 10, I am getting the following:
exec: "cat": executable file not found in %!P(MISSING)ATH%!(NOVERB)

Technically it can be any blocking command.

artursouza · 2020-01-09T08:41:39Z

+
+    public  void destroyDapr() throws IOException {
+        rt.exec("dapr stop --app-id " + this.appName);
+        proc.destroy();


Do you need to wait for sometime before calling destroy?

No, after test cases run, everything is ready to stop the application

artursouza · 2020-01-09T08:42:30Z

+        proc= rt.exec(this.buildDaprCommand(), null,file);
+        InputStream stdin = proc.getInputStream();
+        InputStreamReader isr = new InputStreamReader(stdin);
+        BufferedReader br = new BufferedReader(isr);


You might need to close these readers, not?

yes, now we use the try(resource) approach
https://docs.oracle.com/javase/tutorial/essential/exceptions/tryResourceClose.html

artursouza · 2020-01-09T08:43:58Z

+  public static void main(String[] args) {
+    ManagedChannel channel =
+      ManagedChannelBuilder.forAddress("localhost", 50001).usePlaintext().build();
+    DaprBlockingStub client = DaprGrpc.newBlockingStub(channel);


Indentation.

please review again, let me know if that works

artursouza · 2020-01-09T08:44:40Z

+    private static DaprIntegrationTestingRunner daprIntegrationTestingRunner;
+
+    @BeforeClass
+    public static void init() throws IOException, InterruptedException, TimeoutException, ExecutionException {


Just throws Exception for simplicity. It is OK for tests.

yes, the idea is to fail with an exception the complete build

My comment was just to do the following:
public static void init() throws Exception {

Instead of
public static void init() throws IOException, InterruptedException, TimeoutException, ExecutionException {

this is done

artursouza · 2020-01-09T08:48:27Z

+      SaveStateEnvelope state = SaveStateEnvelope.newBuilder()
+        .addRequests(req)
+        .build();
+      client.saveState(state);


For this particular example, you did not need a separate service class because it is not listening on any port, just invoking dapr. See my comment above: there is a way to start Dapr faking an app just to have it running locally.

I can not resolve the problem using a command like CAT or something similar, so I create an empty class, that allows running DAPR without any service running. I use this approach to test HTTP state functionality.

artursouza · 2020-01-10T19:59:04Z

+public class HelloWorldGrpcStateService {
+
+    public static void main(String[] args) {
+        ManagedChannel channel = ManagedChannelBuilder.forAddress("localhost", 50002).usePlaintext().build();


DAPR_HTTP_PORT or DAPR_GRPC_PORT env vars.

I already change this code, with auto-generate free ports code

artursouza · 2020-01-10T20:01:22Z

+    @Test
+    public void testHelloWorldState(){
+        ManagedChannel channel =
+                ManagedChannelBuilder.forAddress("localhost", 50002).usePlaintext().build();


Here the env variable will not be set. So, we need some code to find a free port,

artursouza · 2020-01-10T20:01:35Z

+                        "BUILD SUCCESS",
+                        HelloWorldGrpcStateService.class,
+                        true,
+                        50002,


Auto detect a free port and send it here.

artursouza · 2020-01-10T20:01:51Z

+    }
+
+    @Test
+    public void test2(){


Empty test?

artursouza · 2020-01-10T20:02:34Z

+                        "BUILD SUCCESS",
+                        EmptyService.class,
+                        false,
+                        3500,


send a auto-detected free port.

artursouza

Almost there.

… to work on MAC and Linux

youngbupark · 2020-01-13T21:01:30Z

+                .append(" --grpc-port ")
+                .append(this.daprFreePorts.grpcPort)
+                .append(" --port ")
+                .append(this.daprFreePorts.httpPort)


I would not recommend to set these options. Rather, user code can read DAPR_HTTP_PORT and DAPR_GRPC_PORT which dapr cli sets.

…r exception

artursouza · 2020-01-14T01:27:47Z

+        Optional.ofNullable(proc).ifPresent(process -> process.destroy());
+    }
+
+


Keep single spaces.

artursouza · 2020-01-14T01:28:05Z

+            return httpPort;
+        }
+
+


reformat code.

artursouza · 2020-01-14T01:28:20Z

+
+
+        public int getAppPort() {
+            return appPort;


spacing is "2" and not "4".

* #26 Add Hello World Integration Testing working on Windows, need work to work on MAC and Linux * #26 Add new Integration Test to test DAPR state functionality * #26 Add Hello World Integration Testing working on Windows, need work to work on MAC and Linux * Update Integration Testing getting free ports automatically * #26 Refractor to use a base class for all the integration tests * #26 Make StateOptions as optional in order to not throw a null pointer exception * #26 Remove empty lines and correct the ident * Adding license to DaprIntegrationTestingRunner Co-authored-by: Young Bu Park <youngp@microsoft.com> Co-authored-by: Artur Souza <artursouza.ms@outlook.com>

* Basic Dapr HTTP Client for Actors. * ActorTypeInformation with parsing logic + some stubs. * Fixing license. * Adding MethodContext + StateSerializer. * Add ActorRuntime (#44) * Add ActorRuntime * split DaprAsyncClient hierarchy into 2 hierarchies for the different directions of communication * Rename DaprClientBase to AbstractDaprClient * Add ActorId * Encapsulating async call in AbstractDaprClient as a single method. (#46) * Add ActorMethodInfoMap (#47) * Add ActorMethodInfoMap * Add ConverterUtils class (#49) * Add ConverterUtils + unit test * Improved async call to okhttp. Former solution just wrapped a blocking call, now we using asynch call and collect the results via callbacks. Mono's are created based on the result. This make more efficient use of the resources since nothing is blocking now. Reformatted according new checkstyle (#48) * More reformatting to 2 spaces indentation. (#50) * Add ActorTimer and related (#51) * Add ActorTimer and related * cr * ActorService + DaprStateProvider + some more. (#53) * Faster JSON building + separate auto-gen jar + tests. (#55) * closed the response objects and returning a string (#56) * Add ReminderInfo (#54) * Add ReminderInfo * remove extra var * More Actors Stuff (#57) * ActorManager * More work done. * Adding example for actor runtime service. * Implements ActorStateManager + fixes + javadocs. * ActorProxy + some refactoring (#62) * ActorManager * More work done. * Adding example for actor runtime service. * Implements ActorStateManager + fixes + javadocs. * Fix OrderManager example in order to process http 201 Change the implement the calls to DAPR using the class AbstractDaprClient because before the change the class always return Mono.Empty Implementation of the ActorAsyncProxy Change the name of the Actor Dapr Http Async Client * Update code with the changes proposed by Artur in the code review * Changes to support ActorProxy + Fixes. Co-authored-by: Juan Jose Herrera <35985447+JuanJose-Herrera@users.noreply.github.com> * Adding new methods for Http Client (#60) * Adding new methods for Http Client * Finishing implementation for HttpClient * Adding JavaDoc and Changing return Type to new Methods * Using ObjectSerializer and changing Constants values * Adding gRPC client adapter, to encapsulate gRPC logic from the user (#61) * Adding a common adapter to be exposed to users, for calling either the gRPC or the HTTP Clients. Implementing gRPC adapter based on interface. Moving ActorStateSerializer and renamed to be used as a generic utility for Serializing objects * Creating a builder for the GrpcClient Abstracting generic serialize and deserialize methods into a generic base class while leaving Actor specific stuff into the ActorStateSerializer class Adding Javadocs * Unit tests for ActorManager + fixes for Timer and Reminder. (#63) * Add UnitTest to ActorProxyImpl and JaCoCo (coverage tool) implementation (#67) * Change from unwrapMethodResponse to deserialize, because the response from an actor method is not wrapped in "Data" object Add Unit test for the ActorProxy class * #24 Implement more testing to the ActorProxyImpl and refactor how we manage the errors with Mono #20 Add the coverage tool JaCoCo, the rules are commented at this moment in order to allow to execute the examples at this moment, if we enable the rules, the compilation fails. * Enable rules for unit test coverage with a minimum of 0 in order to allow the developers to success compile, the minimum should be set to .8 before the projects ends * Use the unwrapMethodResponse of the serilizer in order to deserilize actor responses. * Reverting ActorProxyImpl.java There is not need to change ActorProxyImpl since the previous change to not wrap it with the "data" structure was incorrect. Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Starting package to handle SpringBoot integration. (#69) * Request body must be null on get for okhttp, empty body does not work… (#70) * Request body must be null on get for okhttp, empty body does not work. Also, expose the ActorStateManager methods that ought to be exposed to user. * Make ctor package private and use equals for string compare * Refactoring HTTP Client and creating Client HTTP Adapter (#68) * Refactoring HTTP Client to follow same pattern as the GRPC Client. Creating DaprClientHttpAdapter to be exposed to the users. Refactor all uses of the http Client to use the adapter instead following composition rather than inheritance. Dealing with conflicts * Renaming AppToDaprHttpAsync to AppToDaprHttpAsyncClient changed previously by mistake * Refactor Adapters to centralize all generic and actor specific functionality in the same place, having a single entry point for all communications to DAPR. Leaving GRPC Adapter implemented, but without the possibility to create an instance of it. Fixing Test cases * Addressing PR comments * PubSub + related fixes. (#71) * Fixing issue regarding GET and DELETE method (#76) * Unit tests for PubSub + JavaDocs. (#75) * Invoke service + unit tests. (#78) * Java sdk wip (#77) * Fixing issue regarding GET and DELETE method * Adding unit test for DaprHttp.java * Adding test scope * Renaming a property and fixing conflict to merge. Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * pubsub sample needs update for listener interface (#80) * Fix bindings + add samples (#81) * Fix binding and add samples * Fix sample command line * update comment for name change * lowercase d matches runtime, though it looks like it is case insensitive * Spliting Actor client and runtime into a separate jar. (#83) * Unit testing + bug fixing in GRPC Adapter (#79) * Adding mockito plugin to be able to mock final classes Increasing test coverage for ObjectSerializer Fixing bug in GRPC Adapter while creating the envelopes, found during unit testing. * First step into returning Http Headers as part of the response for the DaprClientHttpAdapter Updating State object to match the API. Fixing Broken Unit Tests and increasing coverage for DaprClientGrpcAdapter * Adding documentation, fixing typos and renaming support method to be more descriptive. * Addressing PR comments Increasing test coverage Fixing Merge conflicts * Addressing PR comments * Addressing comments regarding where to build the query parameters forthe HTTP Client calls. (#84) * Addressing comments regarding where to build the query parameters for the HTTP Client calls. * Making map immutable while also preventing a NPE * Fixing DaprHttp and its tests. (#93) * Increasing test coverage for DaprClientGrpcAdapter (#94) * Upload jacoco test coverage report to artifact storage (#95) * set jacoco report output dir * upload test report * add dapr version info * #26 Integretion Testing Initial Example (#74) * #26 Add Hello World Integration Testing working on Windows, need work to work on MAC and Linux * #26 Add new Integration Test to test DAPR state functionality * #26 Add Hello World Integration Testing working on Windows, need work to work on MAC and Linux * Update Integration Testing getting free ports automatically * #26 Refractor to use a base class for all the integration tests * #26 Make StateOptions as optional in order to not throw a null pointer exception * #26 Remove empty lines and correct the ident * Adding license to DaprIntegrationTestingRunner Co-authored-by: Young Bu Park <youngp@microsoft.com> Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Fixing and finishing unit tests (#97) * Fixing and finishing unit tests * Fixing styling Issues and adding new test * Unit tests for stateful actors + fixes. (#104) * Receiving the StateOptions on save as part of the State, to comply with the DAPR API (#105) * Receiving the StateOptions on save as part of the State, to comply with the DAPR API * #26 Add integration test for Concurrency funtionality in the states module Co-authored-by: Juan Jose Herrera <35985447+JuanJose-Herrera@users.noreply.github.com> Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Deploy Jar packages to Nexus via CI (#106) * Add SNAPSHOT suffix to version * set deployment setup * add ossrh repostiory * OSSRH setting * add deployment steps * exclude examples jar * remove condition * exclude spring boot pkg Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * deactivate should not call save (#108) Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Fixing bug, where call should be deferred instead of async (#102) * Fixing bug, where call should be deferred instead of async * Removing unused pool property Returning null as response body if empty response is found. Adding Test case for validating callback is executed when expected. * Fixing assertion based on previous changes * Adding test case to verify that the call to grpc only happens when the requestor block the thread, instead of in parallel immediately after calling the methods in the adapter. Documenting complex test case * Fixing merge conflicts * Documenting complex test case * Disable GPG sign by default (#111) * [CD] Fix gpg private key import (#113) * fix gpg key import process * add GPG_TTY env setting * revert * rename dapr-sdk to dapr-actors * fix * Fix GPG plugin * [CD] Conditional SNAPSHOT and final release (#115) * Release pkg based on tag and branch * Update build.yml * Update build.yml * Creating unit tests for HttpAdapter + Adding junit 5 dependency + Reformating code (#112) Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Removing springboot jar and adding some unit tests for ActorRuntime. (#114) * Release SNAPSHOT pkg for every build (#118) * Release SNAPSHOT build every build * fix * Fix sample (#119) Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Unit tests for actors, no state. (#117) * actor unit tests, no state clean up a bit * Rename class * Fix merge Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Moving io.dapr.runtime to test + fixing examples accordingly. (#121) * mvn integration-test doesn't work w/o this plugin (#122) * Resolving conflict for PR #110 (#130) * Renaming State domain object. Removing duplicate use of State Options. Adding custom serialize and deserialize classes for StateOptions objects. * #26 Refractor StateOptions to clean unused code * Fixing merge issues. * Fixing unit test for DaprClientHttpAdapterTest after refactoring. Co-authored-by: Juan Jose Herrera <35985447+JuanJose-Herrera@users.noreply.github.com> * Refactor StateOptions and add IT consistency testing (#110) * Renaming State domain object. Removing duplicate use of State Options. Adding custom serialize and deserialize classes for StateOptions objects. * #26 Refractor StateOptions to clean unused code * Fixing merge issues. * #26 Add integration test for states using Retry policies Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Fix IT issues, to run the integration test rember to add the parameter skipITs=false (#131) * Addresses multiple items from design review (#124) * Use byte[] for customer data and serialized data. Fixes for actor demo. * Simplifying ObjectSerializer + handling CloudEvent properly. * Split DaprClient into 3 parts to hide actor APIs. * Remove Actor "dummy" interface. * Supports custom serializer. * Change seriaizer to receive Object directly. * Handling custom serialization in State APIs + enhancements to the state APIs. * Addressing small comment on Mono chain in ActorManager. * Make serializer mandatory, throwing exception when null. * Fix arg parsing problem -Dexec.args= seems to not allow hyphens inside (#136) * Fix bug in Actor due to timer serialization. (#139) * Missing block (#140) * Install local test kafka before running build and tests (#142) * local test kafka docker-compose yaml * add kafka install step * Separate serializer for state. (#135) * Add gRPC State Integration Test (#138) * Add GRP State Integration Test * Explain ignored test cases for GRPC * Explain ignored test cases for GRPC * Update DaprClientTestBuilder.java Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Actor Activation / Deactivation Integartion Test (#144) * Adding common setup for starting dapr applications in Integration Tests. Adding integration test for Actor Activation and Reactivation. * Changing the way parameters are sent to the application running under Dapr in ITs to fix issue found in Ubuntu about wrong parsing. Moving logic of the ActivationClient into the IT class * Fixing compilation issues in test due to rebase from upstream. * Addressing PR comments * Adding more unit test to reach 80% Coverage (#149) * Adding checkstyle + fix style in sdk-actos. (#146) * Update debug instructions since LB is not needed. (#150) * Add E2E testing for bindings (#148) * Add GRP State Integration Test * Explain ignored test cases for GRPC * Explain ignored test cases for GRPC * Update DaprClientTestBuilder.java * Add binding E2E testing. * Add fix binding E2E testing after merge with new changes * Remove example comments Co-authored-by: Artur Souza <artursouza.ms@outlook.com> * Adding documentation for examples (#153) Co-authored-by: Leon Mai <lemai@microsoft.com> Co-authored-by: ji11er <57505038+ji11er@users.noreply.github.com> Co-authored-by: Juan Jose Herrera <35985447+JuanJose-Herrera@users.noreply.github.com> Co-authored-by: mestizoLopez <ing.javierlg@gmail.com> Co-authored-by: Andres Robles <15348598+AndresRoblesMX@users.noreply.github.com> Co-authored-by: Young Bu Park <youngp@microsoft.com> Co-authored-by: Marcos Reyes <59033058+marcosreyes05@users.noreply.github.com>

artursouza reviewed Jan 9, 2020

View reviewed changes

LMWF reviewed Jan 10, 2020

View reviewed changes

Comment thread sdk/src/main/java/io/dapr/runtime/Dapr.java Outdated

artursouza changed the base branch from java_sdk_wip to master January 10, 2020 19:40

artursouza changed the base branch from master to java_sdk_wip January 10, 2020 19:40

artursouza reviewed Jan 10, 2020

View reviewed changes

artursouza suggested changes Jan 10, 2020

View reviewed changes

JuanJose-Herrera added 4 commits January 13, 2020 11:29

#26 Add Hello World Integration Testing working on Windows, need work…

57b4aed

… to work on MAC and Linux

#26 Add new Integration Test to test DAPR state functionality

e1e18b0

#26 Add Hello World Integration Testing working on Windows, need work…

5ffcf7a

… to work on MAC and Linux

Update Integration Testing getting free ports automatically

8988766

youngbupark reviewed Jan 13, 2020

View reviewed changes

youngbupark and others added 5 commits January 13, 2020 16:35

Merge branch 'java_sdk_wip' into java_sdk_wip

c17ae3b

Merge branch 'java_sdk_wip' into java_sdk_wip

3d083d0

#26 Refractor to use a base class for all the integration tests

d82821d

Merge remote-tracking branch 'origin/java_sdk_wip' into java_sdk_wip

3fe5eb4

#26 Make StateOptions as optional in order to not throw a null pointe…

b6d4afd

…r exception

artursouza suggested changes Jan 14, 2020

View reviewed changes

JuanJose-Herrera and others added 3 commits January 13, 2020 19:41

#26 Remove empty lines and correct the ident

ae66c4e

Merge branch 'java_sdk_wip' into java_sdk_wip

01e3068

Adding license to DaprIntegrationTestingRunner

cfcca1d

artursouza self-requested a review January 14, 2020 01:59

artursouza approved these changes Jan 14, 2020

View reviewed changes

artursouza merged commit a0250fd into dapr:java_sdk_wip Jan 14, 2020


		public void initializeDapr() throws IOException, InterruptedException, TimeoutException, ExecutionException {

		File file= new File("../");

		Optional.ofNullable(proc).ifPresent(process -> process.destroy());
		}

Uh oh!

Conversation

JuanJose-Herrera commented Jan 9, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Issue reference

Checklist

Uh oh!

artursouza left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

artursouza left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

JuanJose-Herrera commented Jan 9, 2020 •

edited

Loading