Yes, you have a gateway machine that has access to HDFS and Spark. You can SSH to this machine for:
Run your Spark jobs:
Use interactive Spark command line:
Use HDFS commands to put a file from local to your HDFS or other commands:
hadoop fs command (ex:
hadoop fs -ls /user/hnaacke)
This machine has IP-based protection against all of its ports. In order to access this machine, I need the IP address which your workplace is using.
my ip in google, I find the range and add them to the firewall.
PS: The IP addresses must be from academic establishments (such as RENATER) not individual ADSL.
You can send me these information by private message here: https://chat.iscpif.fr