Skip to content

Commit

Permalink
Clarify comment on parallelism
Browse files Browse the repository at this point in the history
  • Loading branch information
miguno committed Sep 29, 2014
1 parent 4447b62 commit 8dc4afe
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -180,7 +180,7 @@ class KafkaSparkStreamingSpec extends FeatureSpec with Matchers with BeforeAndAf
).map(_._2)
}
val unifiedStream = ssc.union(streams) // Merge the "per-partition" DStreams
val sparkConsumerParallelism = 1 // You'd probably pick a much higher value than 1 in production.
val sparkConsumerParallelism = 1 // You'd probably pick a higher value than 1 in production.
unifiedStream.repartition(sparkConsumerParallelism) // Decouple processing parallelism from #partitions
}

Expand Down

0 comments on commit 8dc4afe

Please sign in to comment.