Python for loop unreasonably stops half way while iterating through CSV rows -


i dealing csv file analysis lecture feedback data, format 

"5631","18650","10",,,"2015-09-18 09:35:11" "18650","null","10",,,"2015-09-18 09:37:12" "18650","5631","10",,,"2015-09-18 09:37:19" "58649","null","6",,,"2015-09-18 09:38:13" "45379","31541","10","its friday","nothing yet keep up","2015-09-18 09:39:46"

i trying rid of bad data. data entries "id1","id2" and corresponding "id2","id1" considered valid.

i using nested loops try find matching entry each row. however, outer loop seems stop half way no reason. here's code

class filter:     file1 = open('encodedpeerinteractions.fa2015.csv')     peerinter = csv.reader(file1,delimiter=',')      def __init__(self):         super()      def filter(self):         file2 = open('filteredinteractions.csv','a')         row in self.peerinter:             print(row)             if row[0] == 'null' or row[1] == 'null':                 continue             id1 = int(row[0])             id2 = int(row[1])             test in self.peerinter:                 if test[0] == 'null' or test[1] == 'null':                     continue                 if int(test[0]) == id2 , int(test[1]) == id1:                     file2.write("\n")                     file2.write(str(row))                     break         file2.close()

i have tried use pdb step trough code, fine first couple loops , jump file2.close() , return. program prints out few valid entries way not enough.

i tested csv file , loaded memory on 18000 entries. tested using print gives same result nothing wrong append file.

edit

now understand problem is. this question says, break out when there's match when there's no match, inner loop consume file without resetting it. when return outer loop ends. should make list or let reset.

you making way more complicated needs be.

given:

$ cat /tmp/so.csv "5631","18650","10",,,"2015-09-18 09:35:11" "18650","null","10",,,"2015-09-18 09:37:12" "18650","5631","10",,,"2015-09-18 09:37:19" "58649","null","6",,,"2015-09-18 09:38:13" "45379","31541","10","its friday","nothing yet keep up","2015-09-18 09:39:46"

you can use csv , filter want:

>>> open('/tmp/so.csv') f: ...    list(filter(lambda row: 'null' not in row[0:2], csv.reader(f))) ...  [['5631', '18650', '10', '', '', '2015-09-18 09:35:11'],   ['18650', '5631', '10', '', '', '2015-09-18 09:37:19'],   ['45379', '31541', '10', 'its friday', 'nothing yet keep up', '2015-09-18 09:39:46']]

-

Comments

Post a Comment

Popular posts from this blog

java - SSE Emitter : Manage timeouts and complete() -

i writing web app multiple listeners(evcentsource sse clients js) connected server . want store sse emitter per connected listener : can done in memory or other means assigning id each client able achieve far now question ; how send response/event specific client connected web app ? while doing sseemmiters stored either getting completed or timed out. how prevent ? how keep sseemmiter available open infinite time (till client closes) , send events selectively .
Read more

jquery - uncaught exception: DataTables Editor - remote hosting of code not allowed -

i'm trying implement crud operation using datatableseditor using datatables.but i'm getting error messages: 1)uncaught exception: datatables editor - remote hosting of code not allowed. please see http://editor.datatables.net details on how purchase editor license 2)typeerror: a.editor undefined 3) $.fn.datatable.editor not constructor" what reason? here configuration: <%@ page language="java" contenttype="text/html; charset=iso-8859-1" pageencoding="iso-8859-1"%> <!doctype html public "-//w3c//dtd html 4.01 transitional//en" "http://www.w3.org/tr/html4/loose.dtd"> <html> <head> <meta http-equiv="content-type" content="text/html; charset=iso-8859-1"> <title>insert title here</title> <link rel="stylesheet" type="text/css" href="//cdn.datatables.net/1.10.12/css/jquery.datatables.min.css"> <link re...
Read more

java - How to resolve error - package com.squareup.okhttp3 doesn't exist? -

i trying convert json java object use of gson in maven, following youtube video guidance - https://www.youtube.com/watch?v=vqgghm9pwe0 , theres error occurs when in main class error - package com.squareup.okhttp3 doesn't exist. code below: java package com.codebeasty.json; import com.squareup.okhttp3.okhttpclient; public class main { private static okhttpclient client = new okhttpclient(); public static void main (string [] args) { } } i put in dependency in pom.xml: <dependencies> <dependency> <groupid>com.squareup.okhttp3</groupid> <artifactid>okhttp</artifactid> <version>3.4.2</version> </dependency> <dependency> <groupid>com.google.code.gson</groupid> <artifactid>gson</artifactid> <version>2.8.0</version> </dependency> </dependencies> i dont understand why doesn't recognize com.squareup. there may need download? have downl...
Read more