Skip to content

Commit 121e1d9

Browse files
committedMar 26, 2016
Improve Error Handling in Local Directory Feeds
This change improves handling of two error types for filesystem based feeds. The first one is the handling of IO Errors which causes the input stream to be closed, and the second one is reacting to missed filesystem events. In both cases, we scan the directory and compare it with the history we have in order to resume from where we last left off. In addition, this change includes some refactoring in external data. Particularly, we get rid of the stream provider layer and instead, stream factories create input streams directly. This is consistent with record reader factories which create readers directly without reader providers. Change-Id: I08d89229e33c91532b1038ba9f7a372f7ca1fdb5 Reviewed-on: https://asterix-gerrit.ics.uci.edu/720 Tested-by: Jenkins <[email protected]> Reviewed-by: Murtadha Hubail <[email protected]>
1 parent cf39bc9 commit 121e1d9

File tree

134 files changed

+3485
-2606
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

134 files changed

+3485
-2606
lines changed
 

‎.gitattributes

+3
Original file line numberDiff line numberDiff line change
@@ -18,3 +18,6 @@
1818

1919
# Explicitly declare binary files
2020
*testdata.txt binary
21+
22+
#Unset sample_01.cvs
23+
asterix-app/data/csv/sample_01.csv text=unset

‎.gitignore

+1
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@ asterix-app/opttest/
1616
asterix-app/parserts/
1717
asterix-app/opt_parserts/
1818
asterix-app/runtime_parserts/
19+
asterix-app/data/csv/beer.csv
1920
asterix-installer/ittest/
2021
asterix-installer/repliationtest/
2122
asterix-installer/src/test/resources/clusterts/asterix-installer-0.8.9-SNAPSHOT-binary-assembly/

0 commit comments

Comments
 (0)
Please sign in to comment.