https://github.com/logicalclocks/hopsworks-ide-plugins
Plugins for popular IDEs (IntelliJ, PyCharm) for working with Hopsworks
https://github.com/logicalclocks/hopsworks-ide-plugins
Last synced: 12 months ago
JSON representation
Plugins for popular IDEs (IntelliJ, PyCharm) for working with Hopsworks
- Host: GitHub
- URL: https://github.com/logicalclocks/hopsworks-ide-plugins
- Owner: logicalclocks
- License: apache-2.0
- Created: 2020-11-19T15:30:01.000Z (over 5 years ago)
- Default Branch: main
- Last Pushed: 2023-01-10T10:16:23.000Z (over 3 years ago)
- Last Synced: 2025-06-06T18:06:50.329Z (about 1 year ago)
- Language: Java
- Size: 76.2 KB
- Stars: 0
- Watchers: 10
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Plugins for popular IDEs (IntelliJ, PyCharm) for working with Hopsworks.
### IntelliJ/PyCharm plugin for executing common job commands on Hopsworks platform.
Work locally on your IntelliJ or PyCharm IDE and execute job actions directly on Hopsworks (create,run,stop,etc.)
#### How to build/install
* Import project with 'Gradle' in the IDE and run the gradle task `:buildPlugin` from gradle tool-bar. To run from command line, run `gradle build` to build source and `gradle buildPlugin` to build the plugin. This will create the `hops-intellij-.zip` within build/distributions folder
* Install this zip via **Settings -> Plugins -> 'Install Plugin from Disk'**
* **Note:** Use Gradle 6.7 or later and JDK 8 or later. To run the plugin within IDE and to avoid out of memory issues, run the gradle task `:runIde` with VM options `-Xmx4096m`.
#### How to use plugin
* Access the 'Hopsworks Job Preferences' UI for specifying user preferences under Settings -> Tools -> Hopsworks Job Preferences.
* Input the Hopworks project preferences and job details you wish to work on.
* Open a Project and within the Project Explorer right click on the program (.jar,.py,.ipynb) you wish to execute as a job on Hopsworks. Different job actions possible are available in the context menu.
* **Note:** The Job Type `Python` only supports Hopsworks-EE
##### Actions
* **Create:** Create or update job as specified in Hopsworks Job Preferences
* **Run:** Uploads the program first to the HDFS path as specficied and runs job
* **Stop:** Stops a job
* **Delete:** Deletes a job
* **Job Execution Status / Job Execution Logs:** Get the job status or logs respectively. You have the option of retrieving a particular job execution by specifying the execution id in the 'Hopsworks Job Preferences' UI, otherwise default is the last execution for the job name specified.
##### Support for running Flink jobs
* You can also submit your local program as a flink job using the plugin. Follow the steps to `Create Job` to first create a flink job in Hopsworks.
* Then click on `Run Job`. This will first start a flink cluster if there is no active running flink job with same job name. Otherwise it will use an active running flink cluster with same job name.
Next it will upload and submit your program to a running flink cluster.
* Set your program main class using the `Main Class` field in preferences. To pass arguments, simply fill it in the `User Arguments`, multiple arguments separated by space. e.g. --arg1 a1 --arg2 a2