0.00.0100005050NY50000YN1000100Slave3localhost8084clusterEncrypted 2be98afc86aa7f2e4cb1aa265cd86aac8NSlave2localhost8083clusterEncrypted 2be98afc86aa7f2e4cb1aa265cd86aac8NSlave1localhost8082clusterEncrypted 2be98afc86aa7f2e4cb1aa265cd86aac8NDI Serverlocalhost9080pentaho-dijoeEncrypted 2be98afc86aa7f2e4bb18bd63c99dbddeNMasterlocalhost8081clusterEncrypted 2be98afc86aa7f2e4cb1aa265cd86aac8YClusterSchema4000020005000YNSlave2Slave1Master-2011/04/26 12:54:07.020-2011/04/26 12:54:07.020Just a quick POC to read in iPhones consolidated.db151526622Microsoft Sans Serif8NN0002551650100100100YCalculate the date. What about timezones?
Could by optimized by a
User Defined Java Expression15217822647Microsoft Sans Serif8NN0002551650100100100YFor some reasons there are invalid data,
filter them out.41717921335Microsoft Sans Serif8NN0002551650100100100YLet's do some simplification and
group on a daily basis6256917435Microsoft Sans Serif8NN0002551650100100100YYou could look up the data by regions, city etc.
store them in a database, visualize ....59030624235Microsoft Sans Serif8NN0002551650100100100YJust use the CELLLOCATION table at this time.
Other tables of interest are in there....197324735Microsoft Sans Serif8NN0002551650100100100Yconsolidated.dbDummySQLITENative${Internal.Transformation.Filename.Directory}/consolidated.dbEncrypted FORCE_IDENTIFIERS_TO_LOWERCASENFORCE_IDENTIFIERS_TO_UPPERCASENIS_CLUSTEREDNQUOTE_ALL_FIELDSNSUPPORTS_BOOLEAN_DATA_TYPENUSE_POOLINGNCELLLOCATIONconvert Mac Absolute TimeYFilter 0 rowsGroup by DailyYconvert Mac Absolute TimeFilter 0 rowsYGroup by DailyEverything.....YCELLLOCATIONTableInputY1noneconsolidated.dbSELECT
MCC
, MNC
, LAC
, CI
, Timestamp
, Latitude
, Longitude
, HorizontalAccuracy
, Altitude
, VerticalAccuracy
, Speed
, Course
, Confidence
FROM CELLLOCATION
0NNN65125Yconvert Mac Absolute TimeCalculatorY1nonetmp1000CONSTANT1000Integer-1-1YtmpMacAbsoluteTimeConvMULTIPLYTimestamptmp1000Integer-1-1YtmpYear2001asDateCONSTANT2001-01-01Date-1-1Yyyyy-MM-ddtmpYear1970asDateCONSTANT1970-01-01Date-1-1Yyyyy-MM-ddtmp30YearsSUBTRACTtmpYear2001asDatetmpYear1970asDateInteger-1-1YlogDateWithTimeADDtmpMacAbsoluteTimeConvtmp30YearsDate-1-1Yyyyy-MM-ddlogDateREMOVE_TIME_FROM_DATElogDateWithTimeDate-1-1Nyyyy-MM-dd265125YGroup by DailyGroupByY1noneNN%%java.io.tmpdir%%grpNNlogDateLatitudeDailyLatitudeFIRST_INCL_NULLLongitudeDailyLongitudeFIRST_INCL_NULL705125YFilter 0 rowsFilterRowsY1noneYNLatitude=constantNumber0.0-1-1N#.#NORLongitude=constantNumber0.0-1-1N#505125YEverything.....DummyY1none705245YN