AP-5460 Several enhancements #1976

franklma · 2022-04-26T05:09:17Z

Only consider non-empty values when guessing the type by reading the 100 rows sample used in Log Importer
The “types” could be made optional and by default, when they are not given, all fields will be treated as “String”. With this “default” convention, maybe we would provide more flexibility to the API.
Corner cases when detecting the data type
Handle "other timestamps" in existing schema mapping
Handle Boolean data type
Add unit tests

mayankgituni · 2022-04-27T05:31:31Z

...ins/Log-Importer-Logic/src/main/java/org/apromore/service/logimporter/model/LogMetaData.java



 @Data
 @NoArgsConstructor
 public class LogMetaData {

+    private static final Logger LOGGER = LoggerFactory.getLogger(LogMetaData.class);


Could use Lombok notation @Sl4j for logging instead of defining LOGGER.

mayankgituni · 2022-04-27T06:27:35Z

...rter-Logic/src/main/java/org/apromore/service/logimporter/utilities/ImporterStringUtils.java

@@ -94,7 +97,12 @@ public static ColumnType getColumnType(final List<String> stringList) {
        temp.put(ColumnType.DOUBLE, 0);
        temp.put(ColumnType.TIMESTAMP, 0);

-        stringList.forEach(st -> {
+        List<String> filteredList = stringList.stream()
+            .filter(Objects::nonNull)
