OpenMole workflow not running on EGI


(Hélène) #1

Hi,

I’ve not been able to run jobs from OpenMole on EGI for the past week. The jobs don’t seem to be loaded and submitted to EGI and I have no idea why or where the problem might come from.
Here is the execution panel I get on OpenMole:

I’ve just re-executed my workflow before sending this message so it’s only been a few minutes this time, but it was exactly the same after trying to run for ~3 days (that’s how long it usually takes to complete the jobs).
The errors I get are the ones I always get when running jobs and it was never an issue.
The workflow I’m trying to run is the same I’ve been successfully running for over a month, I’m just changing input values.

Any ideas what’s going on?

Thanks!

Hélène


#2

There was a problem on the storage last week. It was solved on monday. @jperret told me his jobs were running. Are you still having this problem?


(Hélène) #3

It was still not working on Friday for me.


#4

I just submitted jobs successfully. It seems that the grid is working. There was a big bug with the files upload (fixed recently, 1 week ago) you may update openmole and you may check that your certificate is still valid. If you are still getting these error please click on the error and post the full stack.

Romain


(Hélène) #5

My certificate is still valid.
I’ve downloaded the latest openmole version and now the error is about the workflow, there’s a problem with “–”?

org.openmole.core.console.ScalaREPL$CompilationError: (line 60) overloaded method value -- with alternatives:
  (parameters: org.openmole.core.workflow.transition.TransitionParameter*)org.openmole.core.workflow.puzzle.Puzzle <and>
  (head: org.openmole.core.workflow.puzzle.Puzzle,tail: org.openmole.core.workflow.puzzle.Puzzle*)org.openmole.core.workflow.puzzle.Puzzle <and>
  (to: org.openmole.core.workflow.puzzle.Puzzle,condition: org.openmole.core.expansion.Condition,filter: org.openmole.core.workflow.transition.BlockList)org.openmole.core.workflow.puzzle.Puzzle
 cannot be applied to (org.openmole.core.workflow.puzzle.OutputEnvironmentPuzzleContainer)
       EmptyTask() -- (profilesPi: _*)
                   ^
Error in imports header:
(line -128) overloaded method value -- with alternatives:
  (parameters: org.openmole.core.workflow.transition.TransitionParameter*)org.openmole.core.workflow.puzzle.Puzzle <and>
  (head: org.openmole.core.workflow.puzzle.Puzzle,tail: org.openmole.core.workflow.puzzle.Puzzle*)org.openmole.core.workflow.puzzle.Puzzle <and>
  (to: org.openmole.core.workflow.puzzle.Puzzle,condition: org.openmole.core.expansion.Condition,filter: org.openmole.core.workflow.transition.BlockList)org.openmole.core.workflow.puzzle.Puzzle
 cannot be applied to (org.openmole.core.workflow.puzzle.OutputEnvironmentPuzzleContainer)
       EmptyTask() -- (profilesPi: _*)
                   ^
Compiling code:

class _833bca1d34d1a7a3175d137396b4813d25fc9433Class {
lazy val _imports = new {
lazy val _parent_ = new {
lazy val _parent_ = new {
lazy val envDef = _603d6824d64b8730186b4f46e3dee6ba9a5791fa
}
}
lazy val RModel = _8e136744fccfa68444ae43a0cc8be9e9510dd951
lazy val Objectif_Loglik = _ee6e2edf0e008d6974d0f7b8f3c5cd45a00b6f44
}

import _imports._

private lazy val workDirectory = File(new java.net.URI("file:/home/helene_arduin/.openmole/bfitou/webui/projects/estimation/tous_scenarios/").getPath)
import _parent_._parent_.envDef._
import RModel._
import Objectif_Loglik._


def profile(variable: Val[Double], nbPoints: Int, file: File) = {
  val profileGen =
    GenomeProfile(
      x = variable,
      nX = nbPoints,
      genome = Seq(
        beta in (0.3, 0.7),
        xi in (-50.0, 150.0),
        p0 in (3.0, 4.0),
        pi in (-50.0, 450.0)
      ),
      objective = loglik
    )

  val evolution = SteadyStateEvolution(
    algorithm = profileGen,
    evaluation =  rTask(file) -- objective,
    termination = 5 minutes
    //termination = 10000
  )
  
  val island = IslandEvolution(
    evolution,
    parallelism = 50,
    termination = 10000
  )
  
  val savePopulationHook = SavePopulationHook(
    island,
    //evolution,
    //workDirectory / "cosSeason" / s"${file.getName.dropRight(6)}" / s"${variable.name}"
    workDirectory / "noSeason" / s"${file.getName.dropRight(6)}" / s"${variable.name}"
  )
  
  (island on egi hook savePopulationHook)
  //(evolution on local4 hook savePopulationHook)
}


val profilesXi = 
  for {
    //f <- (workDirectory / "cosSeason" / "data").listFiles
    f <- (workDirectory / "noSeason" / "data").listFiles
    v <- List(xi)
  } yield profile(v, 400, f)
  
  val profilesPi = 
  for {
    //f <- (workDirectory / "cosSeason" / "data").listFiles
    f <- (workDirectory / "noSeason" / "data").listFiles
    v <- List(pi)
  } yield profile(v, 1000, f)


EmptyTask() -- (profilesPi: _*)

// DirectSampling(
//   sampling = scenario in List("baseline1.RData",
//                               "acquisition2.RData", "acquisition4.RData", "acquisition10.RData", "acquisition50.RData",
//                               "transmission2.RData", "transmission4.RData", "transmission7.RData", "transmission10.RData", "transmission17.RData",
//                               "pathogenicity5.RData", "pathogenicity10.RData", "pathogenicity22.RData", "pathogenicity32.RData", "pathogenicity50.RData"),
//   evaluation = EmptyTask() -- (profile(xi, scenario), profile(pi, scenario))
// )
}

lazy val _833bca1d34d1a7a3175d137396b4813d25fc9433 = new _833bca1d34d1a7a3175d137396b4813d25fc9433Class
         
class _603d6824d64b8730186b4f46e3dee6ba9a5791faClass {
lazy val _imports = new {

}

import _imports._

private lazy val workDirectory = File(new java.net.URI("file:/home/helene_arduin/.openmole/bfitou/webui/projects/").getPath)
val local4 = LocalEnvironment(4)
val local6 = LocalEnvironment(6)
val local8 = LocalEnvironment(8)

val tars = SLURMEnvironment(
  "harduin",
  "tars.pasteur.fr",
  workDirectory = "/local/scratch/",
  qos = "fast"
  )

val egi = EGIEnvironment("vo.complex-systems.eu")
}

lazy val _603d6824d64b8730186b4f46e3dee6ba9a5791fa = new _603d6824d64b8730186b4f46e3dee6ba9a5791faClass
         
class _8e136744fccfa68444ae43a0cc8be9e9510dd951Class {
lazy val _imports = new {

}

import _imports._

private lazy val workDirectory = File(new java.net.URI("file:/home/helene_arduin/.openmole/bfitou/webui/projects/estimation/tous_scenarios/").getPath)
// Variables
val beta = Val[Double]
val xi = Val[Double]
val p0 = Val[Double]
val pi = Val[Double]

// Données
val dossier = Val[String]

// Outputs
// val simu = Val[File]
val param = Val[File]

// R task
def rTask(file: File) = CARETask(
  workDirectory / "profilsLulla.tgz.bin",
  "R -f mainLulla.R --slave --args ${beta} ${xi} ${p0} ${pi} ${dossier} /tmp/${dossier}/data/file.RData") set (
  (inputs, outputs) += (beta, xi, p0, pi, dossier),
  
  resources += (file, "/tmp/${dossier}/data/file.RData"),
  
  // Si un fichier est créé dans le script R
  // il faut le mettre dans les outputFiles
  // avec le même nom que dans R
  // outputFiles += ("simu.csv", simu),
  outputFiles += ("param.txt", param),
  
  // Default values
  beta := 0.45,
  xi := 79.067060,
  p0 := 3.5,
  pi := 92.0,
  //dossier := "cosSeason"
  dossier := "noSeason"
)

EmptyTask()

// Récupérer le fichier de simulation
// val getSimu = CopyFileHook(
//   simu,
//   workDirectory / "${dossier}" / "simu_${beta}.csv"
// )

// Récupérer les valeurs de paramètres et de loglik
// val catSimuFile = AppendToFileHook(
//   // Fichier dans lequel copier
//   workDirectory / "${dossier}" / "simuFile.txt",
//   // Contenu à copier
//   "${param.content}"
// )

// rTask hook (getSimu, catSimuFile)
}

lazy val _8e136744fccfa68444ae43a0cc8be9e9510dd951 = new _8e136744fccfa68444ae43a0cc8be9e9510dd951Class
         
class _ee6e2edf0e008d6974d0f7b8f3c5cd45a00b6f44Class {
lazy val _imports = new {
lazy val RModel = _8e136744fccfa68444ae43a0cc8be9e9510dd951
}

import _imports._

private lazy val workDirectory = File(new java.net.URI("file:/home/helene_arduin/.openmole/bfitou/webui/projects/estimation/tous_scenarios/").getPath)
import RModel._

val loglik = Val[Double]

val objective = 
  ScalaTask("val loglik = if (param.content.isEmpty) 1000000000 else -param.content.toDouble") set (
    inputs += (param),
    outputs += (loglik)
  )
  
objective
}

lazy val _ee6e2edf0e008d6974d0f7b8f3c5cd45a00b6f44 = new _ee6e2edf0e008d6974d0f7b8f3c5cd45a00b6f44Class
         
     

def runOMSScript(): org.openmole.core.workflow.puzzle.Puzzle = {
import _833bca1d34d1a7a3175d137396b4813d25fc9433._imports._
import _parent_._parent_.envDef._
import RModel._
import Objectif_Loglik._


def profile(variable: Val[Double], nbPoints: Int, file: File) = {
  val profileGen =
    GenomeProfile(
      x = variable,
      nX = nbPoints,
      genome = Seq(
        beta in (0.3, 0.7),
        xi in (-50.0, 150.0),
        p0 in (3.0, 4.0),
        pi in (-50.0, 450.0)
      ),
      objective = loglik
    )

  val evolution = SteadyStateEvolution(
    algorithm = profileGen,
    evaluation =  rTask(file) -- objective,
    termination = 5 minutes
    //termination = 10000
  )
  
  val island = IslandEvolution(
    evolution,
    parallelism = 50,
    termination = 10000
  )
  
  val savePopulationHook = SavePopulationHook(
    island,
    //evolution,
    //workDirectory / "cosSeason" / s"${file.getName.dropRight(6)}" / s"${variable.name}"
    workDirectory / "noSeason" / s"${file.getName.dropRight(6)}" / s"${variable.name}"
  )
  
  (island on egi hook savePopulationHook)
  //(evolution on local4 hook savePopulationHook)
}


val profilesXi = 
  for {
    //f <- (workDirectory / "cosSeason" / "data").listFiles
    f <- (workDirectory / "noSeason" / "data").listFiles
    v <- List(xi)
  } yield profile(v, 400, f)
  
  val profilesPi = 
  for {
    //f <- (workDirectory / "cosSeason" / "data").listFiles
    f <- (workDirectory / "noSeason" / "data").listFiles
    v <- List(pi)
  } yield profile(v, 1000, f)


EmptyTask() -- (profilesPi: _*)

// DirectSampling(
//   sampling = scenario in List("baseline1.RData",
//                               "acquisition2.RData", "acquisition4.RData", "acquisition10.RData", "acquisition50.RData",
//                               "transmission2.RData", "transmission4.RData", "transmission7.RData", "transmission10.RData", "transmission17.RData",
//                               "pathogenicity5.RData", "pathogenicity10.RData", "pathogenicity22.RData", "pathogenicity32.RData", "pathogenicity50.RData"),
//   evaluation = EmptyTask() -- (profile(xi, scenario), profile(pi, scenario))
// )
}
runOMSScript()
	at org.openmole.core.console.ScalaREPL$CompilationError.copy(ScalaREPL.scala:54)
	at org.openmole.core.console.ScalaREPL$CompilationError$$anon$3$$anonfun$modifyF$1.apply(ScalaREPL.scala:54)
	at org.openmole.core.console.ScalaREPL$CompilationError$$anon$3$$anonfun$modifyF$1.apply(ScalaREPL.scala:54)
	at scalaz.Monad$$anonfun$map$1$$anonfun$apply$2.apply(Monad.scala:14)
	at scalaz.IdInstances$$anon$1.point(Id.scala:20)
	at scalaz.Monad$$anonfun$map$1.apply(Monad.scala:14)
	at scalaz.IdInstances$$anon$1.bind(Id.scala:22)
	at scalaz.Monad$class.map(Monad.scala:14)
	at scalaz.IdInstances$$anon$1.map(Id.scala:19)
	at org.openmole.core.console.ScalaREPL$CompilationError$$anon$3.modifyF(ScalaREPL.scala:54)
	at org.openmole.core.console.ScalaREPL$CompilationError$$anon$3.modifyF(ScalaREPL.scala:54)
	at monocle.PLens$$anon$5.modifyF(Lens.scala:190)
	at monocle.PTraversal$$anon$2.modifyF(Traversal.scala:113)
	at monocle.PTraversal$$anon$2.modifyF(Traversal.scala:113)
	at monocle.PTraversal$$anon$2.modifyF(Traversal.scala:113)
	at monocle.PTraversal$$anon$2.modifyF(Traversal.scala:113)
	at monocle.PTraversal.monocle$PTraversal$$$anonfun$8(Traversal.scala:69)
	at scala.Function1$$anonfun$andThen$1.apply(Function1.scala:52)
	at org.openmole.core.project.Project.compile$1(Project.scala:155)
	at org.openmole.core.project.Project.compile(Project.scala:161)
	at org.openmole.gui.server.core.ApiImpl.runScript(ApiImpl.scala:316)
	at org.openmole.gui.server.core.GUIServlet$$anonfun$2$$anonfun$applyOrElse$24.apply$mcV$sp(GUIServlet.scala:332)
	at org.openmole.gui.server.core.GUIServlet$$anonfun$2$$anonfun$applyOrElse$24.apply(GUIServlet.scala:332)
	at org.openmole.gui.server.core.GUIServlet$$anonfun$2$$anonfun$applyOrElse$24.apply(GUIServlet.scala:332)
	at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
	at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
	at scala.concurrent.impl.ExecutionContextImpl$AdaptedForkJoinTask.exec(ExecutionContextImpl.scala:121)
	at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: javax.script.ScriptException: compile-time error
	at scala.tools.nsc.interpreter.IMain.compiled(IMain.scala:602)
	at scala.tools.nsc.interpreter.IMain.eval(IMain.scala:1074)
	at javax.script.AbstractScriptEngine.eval(AbstractScriptEngine.java:264)
	at scala.tools.nsc.interpreter.IMain.compile(IMain.scala:1068)
	at org.openmole.core.console.ScalaREPL.compile(ScalaREPL.scala:194)
	at org.openmole.core.project.Project.compile$1(Project.scala:132)
	... 12 more

#6

Hi Helene,

I fixed the syntax in the freshly released 7-RC7, could try it?

Romain


(Hélène) #7

With 7-RC7 it’s back to the previous errors, the files are not loading on EGI.

Error #1

java.io.IOException: Error exists /dpm/grid.auth.gr/home/vo.complex-systems.eu/openmole-653172af-9639-4299-a42a-5a561b88feee/ https://se01.grid.auth.gr:443//
	at fr.iscpif.gridscale.storage.Storage$class.errorWrapping(Storage.scala:72)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.fr$iscpif$gridscale$http$DPMWebDAVStorage$$super$errorWrapping(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class.errorWrapping(DPMWebDAVStorage.scala:179)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.errorWrapping(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:77)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.wrapException(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$class.exists(Storage.scala:54)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.exists(DPMWebDAVStorage.scala:44)
	at org.openmole.plugin.environment.gridscale.GridScaleStorage$class._exists(GridScaleStorage.scala:30)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1._exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply$mcZ$sp(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.control.LimitedAccess$LimitedAccessToken.access(LimitedAccess.scala:37)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.exists(StorageService.scala:195)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.org$openmole$plugin$environment$egi$EGIStorageService$$super$exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply$mcZ$sp(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.QualityControl$$anonfun$quality$1.apply(AvailabitityQuality.scala:70)
	at org.openmole.plugin.environment.egi.QualityControl$class.timed(AvailabitityQuality.scala:83)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.timed(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.QualityControl$class.quality(AvailabitityQuality.scala:68)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.quality(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.EGIStorageService$class.exists(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.createBasePath(StorageService.scala:105)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.createBasePath(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.baseDir(StorageService.scala:97)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.baseDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.org$openmole$plugin$environment$batch$storage$StorageService$$createTmpDir(StorageService.scala:156)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.tmpDir(StorageService.scala:151)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.tmpDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:80)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:72)
	at org.openmole.core.workspace.NewFile.withTmpFile(NewFile.scala:21)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.initCommunication(UploadActor.scala:72)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.receive(UploadActor.scala:52)
	at org.openmole.plugin.environment.batch.refresh.JobManager$DispatcherActor$.receive(JobManager.scala:47)
	at org.openmole.plugin.environment.batch.refresh.JobManager$$anonfun$dispatch$1.apply$mcV$sp(JobManager.scala:57)
	at org.openmole.core.threadprovider.ThreadProvider$RunClosure.run(ThreadProvider.scala:21)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to se01.grid.auth.gr:443 [se01.grid.auth.gr/155.207.121.5] failed: Connection refused (Connection refused)
	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:158)
	at org.apache.http.impl.conn.BasicHttpClientConnectionManager.connect(BasicHttpClientConnectionManager.java:338)
	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_exists$1.apply(DPMWebDAVStorage.scala:163)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_exists$1.apply(DPMWebDAVStorage.scala:160)
	at fr.iscpif.gridscale.http.HTTPSClient$class.withClient(HTTPSClient.scala:48)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.withClient(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class._exists(DPMWebDAVStorage.scala:160)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1._exists(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply$mcZ$sp(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:75)
	... 67 more
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:589)
	at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:337)
	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:141)
	... 86 more

Error #2

java.io.IOException: Error exists /dpm/lal.in2p3.fr/home/vo.complex-systems.eu/openmole-653172af-9639-4299-a42a-5a561b88feee/ https://grid05.lal.in2p3.fr:443//
	at fr.iscpif.gridscale.storage.Storage$class.errorWrapping(Storage.scala:72)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.fr$iscpif$gridscale$http$DPMWebDAVStorage$$super$errorWrapping(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class.errorWrapping(DPMWebDAVStorage.scala:179)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.errorWrapping(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:77)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.wrapException(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$class.exists(Storage.scala:54)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.exists(DPMWebDAVStorage.scala:44)
	at org.openmole.plugin.environment.gridscale.GridScaleStorage$class._exists(GridScaleStorage.scala:30)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1._exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply$mcZ$sp(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.control.LimitedAccess$LimitedAccessToken.access(LimitedAccess.scala:37)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.exists(StorageService.scala:195)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.org$openmole$plugin$environment$egi$EGIStorageService$$super$exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply$mcZ$sp(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.QualityControl$$anonfun$quality$1.apply(AvailabitityQuality.scala:70)
	at org.openmole.plugin.environment.egi.QualityControl$class.timed(AvailabitityQuality.scala:83)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.timed(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.QualityControl$class.quality(AvailabitityQuality.scala:68)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.quality(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.EGIStorageService$class.exists(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.createBasePath(StorageService.scala:105)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.createBasePath(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.baseDir(StorageService.scala:97)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.baseDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.org$openmole$plugin$environment$batch$storage$StorageService$$createTmpDir(StorageService.scala:156)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.tmpDir(StorageService.scala:151)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.tmpDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:80)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:72)
	at org.openmole.core.workspace.NewFile.withTmpFile(NewFile.scala:21)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.initCommunication(UploadActor.scala:72)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.receive(UploadActor.scala:52)
	at org.openmole.plugin.environment.batch.refresh.JobManager$DispatcherActor$.receive(JobManager.scala:47)
	at org.openmole.plugin.environment.batch.refresh.JobManager$$anonfun$dispatch$1.apply$mcV$sp(JobManager.scala:57)
	at org.openmole.core.threadprovider.ThreadProvider$RunClosure.run(ThreadProvider.scala:21)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:210)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)
	at sun.security.ssl.SSLSocketImpl.waitForClose(SSLSocketImpl.java:1769)
	at sun.security.ssl.HandshakeOutStream.flush(HandshakeOutStream.java:124)
	at sun.security.ssl.Handshaker.sendChangeCipherSpec(Handshaker.java:1099)
	at sun.security.ssl.ClientHandshaker.sendChangeCipherAndFinish(ClientHandshaker.java:1216)
	at sun.security.ssl.ClientHandshaker.serverHelloDone(ClientHandshaker.java:1128)
	at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:348)
	at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1026)
	at sun.security.ssl.Handshaker.process_record(Handshaker.java:961)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1062)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1375)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1403)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1387)
	at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:394)
	at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:353)
	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:141)
	at org.apache.http.impl.conn.BasicHttpClientConnectionManager.connect(BasicHttpClientConnectionManager.java:338)
	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_exists$1.apply(DPMWebDAVStorage.scala:163)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_exists$1.apply(DPMWebDAVStorage.scala:160)
	at fr.iscpif.gridscale.http.HTTPSClient$class.withClient(HTTPSClient.scala:48)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.withClient(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class._exists(DPMWebDAVStorage.scala:160)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1._exists(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply$mcZ$sp(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:75)
	... 67 more

#8

The first error is normal this storage element is not working. However the second one should not occur.

Could you try to log here with the browser in which you have your certificate stored, and tell me if it works:
https://grid05.lal.in2p3.fr/dpm/lal.in2p3.fr/home/vo.complex-systems.eu/


(Hélène) #9

It’s working.


#10

Is this on the same computers which runs OpenMOLE?


(Hélène) #11

I forgot to copy-paste the 3rd error I get, but I think you told me before it was normal to get it too.

fr.iscpif.gridscale.package$ConnectionError: make dir /dpm on https://se01.afroditi.hellasgrid.gr:443//
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class.errorWrapping(DPMWebDAVStorage.scala:178)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.errorWrapping(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:77)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.wrapException(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$class.makeDir(Storage.scala:50)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.makeDir(DPMWebDAVStorage.scala:44)
	at org.openmole.plugin.environment.gridscale.GridScaleStorage$class._makeDir(GridScaleStorage.scala:33)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1._makeDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$makeDir$1.apply$mcV$sp(StorageService.scala:198)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$makeDir$1.apply(StorageService.scala:198)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$makeDir$1.apply(StorageService.scala:198)
	at org.openmole.plugin.environment.batch.control.LimitedAccess$LimitedAccessToken.access(LimitedAccess.scala:37)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.makeDir(StorageService.scala:198)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.org$openmole$plugin$environment$egi$EGIStorageService$$super$makeDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$makeDir$1.apply$mcV$sp(EGIStorageService.scala:46)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$makeDir$1.apply(EGIStorageService.scala:46)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$makeDir$1.apply(EGIStorageService.scala:46)
	at org.openmole.plugin.environment.egi.QualityControl$$anonfun$quality$1.apply(AvailabitityQuality.scala:70)
	at org.openmole.plugin.environment.egi.QualityControl$class.timed(AvailabitityQuality.scala:83)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.timed(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.QualityControl$class.quality(AvailabitityQuality.scala:68)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.quality(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.EGIStorageService$class.makeDir(EGIStorageService.scala:46)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.makeDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$mkRootDir$1.apply(StorageService.scala:115)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$mkRootDir$1.apply(StorageService.scala:113)
	at scala.collection.immutable.Stream.foldLeft(Stream.scala:610)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.mkRootDir(StorageService.scala:112)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.mkRootDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.createBasePath(StorageService.scala:100)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.createBasePath(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.baseDir(StorageService.scala:97)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.baseDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.org$openmole$plugin$environment$batch$storage$StorageService$$createTmpDir(StorageService.scala:156)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.tmpDir(StorageService.scala:151)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.tmpDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:80)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:72)
	at org.openmole.core.workspace.NewFile.withTmpFile(NewFile.scala:21)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.initCommunication(UploadActor.scala:72)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.receive(UploadActor.scala:52)
	at org.openmole.plugin.environment.batch.refresh.JobManager$DispatcherActor$.receive(JobManager.scala:47)
	at org.openmole.plugin.environment.batch.refresh.JobManager$$anonfun$dispatch$1.apply$mcV$sp(JobManager.scala:57)
	at org.openmole.core.threadprovider.ThreadProvider$RunClosure.run(ThreadProvider.scala:21)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.conn.ConnectTimeoutException: Connect to se01.afroditi.hellasgrid.gr:443 [se01.afroditi.hellasgrid.gr/195.251.55.117] failed: connect timed out
	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:150)
	at org.apache.http.impl.conn.BasicHttpClientConnectionManager.connect(BasicHttpClientConnectionManager.java:338)
	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_makeDir$1$$anonfun$apply$2.apply(DPMWebDAVStorage.scala:122)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_makeDir$1$$anonfun$apply$2.apply(DPMWebDAVStorage.scala:122)
	at fr.iscpif.gridscale.http.HTTPStorage$.execute(HTTPStorage.scala:131)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_makeDir$1.apply(DPMWebDAVStorage.scala:122)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_makeDir$1.apply(DPMWebDAVStorage.scala:120)
	at fr.iscpif.gridscale.http.HTTPSClient$class.withClient(HTTPSClient.scala:48)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.withClient(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class._makeDir(DPMWebDAVStorage.scala:120)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1._makeDir(DPMWebDAVStorage.scala:44)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$makeDir$1.apply$mcV$sp(Storage.scala:50)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$makeDir$1.apply(Storage.scala:50)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$makeDir$1.apply(Storage.scala:50)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:75)
	... 72 more
Caused by: java.net.SocketTimeoutException: connect timed out
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:589)
	at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:337)
	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:141)
	... 94 more

#12

Indeed, it is normal as well.


(Hélène) #13

Yes it’s all on the same computer.


#14

Wahou, so weird. Could you try to remove a directory called ~/.opemole//persistent/CACertificates, restart openmole and retry?


(Hélène) #15

Nothing changed.


#16

I really don’t know why it happens. We are refactoring in depth the environment in OpenMOLE. Hopefully it will make think way more stable in the next version. Meanwhile I can provide you with a cloud hosted OpenMOLE instance that should work. I send you the details by mail.


(Hélène) #17

Hello,

I need to run some simulations using the same scripts than 2 months ago and I get the same error as before.

java.io.IOException: Error exists /dpm/lal.in2p3.fr/home/vo.complex-systems.eu/openmole-d63801d8-fd85-4c21-bf3c-0a9b7b4f907c/ https://grid05.lal.in2p3.fr:443//
	at fr.iscpif.gridscale.storage.Storage$class.errorWrapping(Storage.scala:72)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.fr$iscpif$gridscale$http$DPMWebDAVStorage$$super$errorWrapping(DPMWebDAVStorage.scala:43)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class.errorWrapping(DPMWebDAVStorage.scala:173)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.errorWrapping(DPMWebDAVStorage.scala:43)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:77)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.wrapException(DPMWebDAVStorage.scala:43)
	at fr.iscpif.gridscale.storage.Storage$class.exists(Storage.scala:54)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.exists(DPMWebDAVStorage.scala:43)
	at org.openmole.plugin.environment.gridscale.GridScaleStorage$class._exists(GridScaleStorage.scala:30)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1._exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply$mcZ$sp(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$exists$1.apply(StorageService.scala:195)
	at org.openmole.plugin.environment.batch.control.LimitedAccess$LimitedAccessToken.access(LimitedAccess.scala:37)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.exists(StorageService.scala:195)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.org$openmole$plugin$environment$egi$EGIStorageService$$super$exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply$mcZ$sp(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIStorageService$$anonfun$exists$1.apply(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.QualityControl$$anonfun$quality$1.apply(AvailabitityQuality.scala:70)
	at org.openmole.plugin.environment.egi.QualityControl$class.timed(AvailabitityQuality.scala:83)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.timed(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.QualityControl$class.quality(AvailabitityQuality.scala:68)
	at org.openmole.plugin.environment.egi.AvailabilityQuality$$anon$1.quality(AvailabitityQuality.scala:25)
	at org.openmole.plugin.environment.egi.EGIStorageService$class.exists(EGIStorageService.scala:43)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.exists(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.createBasePath(StorageService.scala:105)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.createBasePath(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1$$anonfun$apply$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$baseDir$1.apply(StorageService.scala:97)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.baseDir(StorageService.scala:97)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.baseDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.org$openmole$plugin$environment$batch$storage$StorageService$$createTmpDir(StorageService.scala:156)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1$$anonfun$apply$4.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anon$2.call(StorageService.scala:88)
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4793)
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3542)
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2323)
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2286)
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2201)
	at com.google.common.cache.LocalCache.get(LocalCache.java:3953)
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4790)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.plugin.environment.batch.storage.StorageService$$anonfun$tmpDir$1.apply(StorageService.scala:151)
	at org.openmole.tool.cache.package$.unwrap(package.scala:22)
	at org.openmole.plugin.environment.batch.storage.StorageService$class.tmpDir(StorageService.scala:151)
	at org.openmole.plugin.environment.egi.EGIWebDAVStorageService$$anon$1.tmpDir(EGIStorageService.scala:110)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:80)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$$anonfun$initCommunication$1.apply(UploadActor.scala:72)
	at org.openmole.core.workspace.NewFile.withTmpFile(NewFile.scala:21)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.initCommunication(UploadActor.scala:72)
	at org.openmole.plugin.environment.batch.refresh.UploadActor$.receive(UploadActor.scala:52)
	at org.openmole.plugin.environment.batch.refresh.JobManager$DispatcherActor$.receive(JobManager.scala:47)
	at org.openmole.plugin.environment.batch.refresh.JobManager$$anonfun$dispatch$1.apply$mcV$sp(JobManager.scala:57)
	at org.openmole.core.threadprovider.ThreadProvider$RunClosure.run(ThreadProvider.scala:21)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.NoHttpResponseException: grid05.lal.in2p3.fr:443 failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:165)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_exists$1.apply(DPMWebDAVStorage.scala:158)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anonfun$_exists$1.apply(DPMWebDAVStorage.scala:155)
	at fr.iscpif.gridscale.http.HTTPSClient$class.withClient(HTTPSClient.scala:48)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1.withClient(DPMWebDAVStorage.scala:43)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$class._exists(DPMWebDAVStorage.scala:155)
	at fr.iscpif.gridscale.http.DPMWebDAVStorage$$anon$1._exists(DPMWebDAVStorage.scala:43)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply$mcZ$sp(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$$anonfun$exists$1.apply(Storage.scala:54)
	at fr.iscpif.gridscale.storage.Storage$class.wrapException(Storage.scala:75)
	... 67 more

This error had been resolved on the cloud hosted OpenMOLE instance you provided but not anymore with the new version of OpenMOLE, and it’s not working either when I run OpenMOLE directly on my computer with the 7.1 version.

Any idea what’s going on?

Thanks!

Hélène


#18

Hi Helene,

I’ve not much clue of what is happening. I updated you’re openmole version to the lastest dev version in which the grid plugin has been entirely reworked. Could you check if it present the same pb ?

Romain


(Hélène) #19

Thanks Romain.
Did you change the way to import other scripts in the main script in this version? My imports are not working anymore.

org.openmole.core.console.ScalaREPL$CompilationError: (line 2) not found: value RModel
import RModel._
       ^
(line 3) not found: value Objectif_Loglik
import Objectif_Loglik._
       ^

(Hélène) #20

Found the change with a little digging :slight_smile:
My jobs are submitted and starting to run on EGI. Some new errors occurring while running though, but no failed jobs so far so it might be ok.