Skip to content
This repository has been archived by the owner on Oct 8, 2020. It is now read-only.

Feature/flink jena #14

Merged
merged 28 commits into from
Jun 28, 2019
Merged
Changes from 1 commit
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
44067c4
Flink reasoning with Jena datastructures.
LorenzBuehmann Jun 26, 2018
24d641b
Merge branch 'develop' into feature/flink-jena
LorenzBuehmann Jun 27, 2018
2df2c0c
Cont. Flink RDF
LorenzBuehmann Jun 27, 2018
7d231ec
Minor Pom changes
LorenzBuehmann Dec 9, 2016
272f0e7
Flink reasoning with Jena datastructures.
LorenzBuehmann Jun 26, 2018
69624cf
Cont. Flink RDF
LorenzBuehmann Jun 27, 2018
8719a31
Use RDF layer for loading/writing
LorenzBuehmann Jun 16, 2019
ec65954
Merge branch 'feature/flink-jena' of github.com:SANSA-Stack/SANSA-Inf…
LorenzBuehmann Jun 16, 2019
4d99e4f
Key type wrapper.
LorenzBuehmann Jun 17, 2019
fc07298
Flink needs either key type or key selector function for join()
LorenzBuehmann Jun 17, 2019
be1bf6f
Minor changes in main entry class, e.g. always write to disk and bump…
LorenzBuehmann Jun 17, 2019
3a34c4a
Merge branch 'develop' into feature/flink-jena
LorenzBuehmann Jun 18, 2019
095b5a0
boolean function utils.
LorenzBuehmann Jun 27, 2019
04effc9
POM cleanup
LorenzBuehmann Jun 27, 2019
3dd33b9
Merge remote-tracking branch 'origin/feature/0.6.0-SNAPSHOT' into fea…
LorenzBuehmann Jun 27, 2019
d5e6b6c
Utils simplified
LorenzBuehmann Jun 27, 2019
7cf311c
Extended test output if test fails.
LorenzBuehmann Jun 27, 2019
f66a9e0
Simplified conversion from RDD[Triple] to Jena Model
LorenzBuehmann Jun 27, 2019
79e2e3a
minor changes in I/O
LorenzBuehmann Jun 27, 2019
9da7479
subtraction operation for Flink DataSet with Jena Triple
LorenzBuehmann Jun 27, 2019
2e84e5b
Improved Flink conformance test setup
LorenzBuehmann Jun 27, 2019
89394b0
log output of test base class
LorenzBuehmann Jun 27, 2019
af1ff94
Flink conformance test clean up
LorenzBuehmann Jun 28, 2019
8a4d6d3
Flink reasoning on Triple DataSet
LorenzBuehmann Jun 28, 2019
634099a
Added missing deps for dist package
LorenzBuehmann Jun 28, 2019
2ddb2f9
Minor
LorenzBuehmann Jun 28, 2019
b5e03b2
Scalastyle cleanup
LorenzBuehmann Jun 28, 2019
50260fe
Merge branch 'develop' into feature/flink-jena
GezimSejdiu Jun 28, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Minor changes in main entry class, e.g. always write to disk and bump…
…ed CLI version.
  • Loading branch information
LorenzBuehmann committed Jun 17, 2019
commit be1bf6f9a646ed4ccc570a87b9049e900dae6797
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,8 @@ import net.sansa_stack.inference.rules.ReasoningProfile._
import net.sansa_stack.inference.rules.{RDFSLevel, ReasoningProfile}

/**
* The class to compute the RDFS materialization of a given RDF graph.
* A class to compute the materialization of a given RDF graph for a given reasoning profile.
* Basically, used as the main class for inference.
*
* @author Lorenz Buehmann
*
Expand Down Expand Up @@ -66,6 +67,7 @@ object RDFGraphMaterializer {

// set up the execution environment
val env = ExecutionEnvironment.getExecutionEnvironment
// and disable logging to standard out
env.getConfig.disableSysoutLogging()
// env.setParallelism(4)

Expand All @@ -89,10 +91,10 @@ object RDFGraphMaterializer {

// compute inferred graph
val inferredGraph = reasoner.apply(graph)
println(s"|G_inf| = ${inferredGraph.size}")
// println(s"|G_inf| = ${inferredGraph.size}")

// write triples to disk
// RDFGraphWriter.writeToDisk(inferredGraph, output, writeToSingleFile, sortedOutput)
RDFGraphWriter.writeToDisk(inferredGraph, output, writeToSingleFile, sortedOutput)

// println(env.getExecutionPlan())

Expand All @@ -118,7 +120,7 @@ object RDFGraphMaterializer {

// the CLI parser
val parser = new scopt.OptionParser[Config]("RDFGraphMaterializer") {
head("RDFGraphMaterializer", "0.4.0")
head("RDFGraphMaterializer", "0.5.0")

// opt[Seq[File]]('i', "input").required().valueName("<path1>,<path2>,...").
// action((x, c) => c.copy(in = x)).
Expand Down