You're talking about communication between two applications where the second application will respond to an event happening within the first one? I.e. closing down when the button's click event is triggered.
I would suggest a different take. Instead of making the second application, well, an application then create it as a windows service. Windows services are easy to both start, stop, and pause from external applications and they are well-suited for operations that require no interface and needs to be running at all times without user-interaction. Visual Studio allows you to create services just like your create normal applications.