<p>after doing cat file | tr -d '\000' > new_file<br>
diff file new_file</p>
<p>diff shows nothing and the md5sums are the same.</p>
<p>reason there are so many non ascii characters<br>
There are lots of information things like ALT Characters <a href="http://www.tedmontgomery.com/tutorial/altchrc-a.html">http://www.tedmontgomery.com/tutorial/altchrc-a.html</a> <<< been in the same file for years now >>></p>
<p>lots of newer console output are using things like  "●" docker, systemd, pip etc</p>
<p>It also appear some chars have corrupted to some extent £ has turned into "£" as an example.</p>
<p>Cheers<br>
Daz</p>

<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br />You are receiving this because you are subscribed to this thread.<br />Reply to this email directly, <a href="https://github.com/geany/geany/issues/1540#issuecomment-316969139">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/ABDrJ8TFw3NQBEUadVdSzGl5aGY0_zi6ks5sQIBFgaJpZM4OXZIY">mute the thread</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/ABDrJzaTgKAbrsQu0qXEmOkU84cwdVvdks5sQIBFgaJpZM4OXZIY.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
<div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
  <link itemprop="url" href="https://github.com/geany/geany/issues/1540#issuecomment-316969139"></link>
  <meta itemprop="name" content="View Issue"></meta>
</div>
<meta itemprop="description" content="View this Issue on GitHub"></meta>
</div>

<script type="application/json" data-scope="inboxmarkup">{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/geany/geany","title":"geany/geany","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/geany/geany"}},"updates":{"snippets":[{"icon":"PERSON","message":"@hdaz000700 in #1540: after doing cat file | tr -d '\\000' \u003e new_file \r\ndiff file new_file\r\n\r\ndiff shows nothing and the md5sums are the same.\r\n\r\nreason there are so many non ascii characters\r\nThere are lots of information things like ALT Characters http://www.tedmontgomery.com/tutorial/altchrc-a.html \u003c\u003c\u003c been in the same file for years now \u003e\u003e\u003e \r\n\r\nlots of newer console output are using things like  \"●\" docker, systemd, pip etc \r\n\r\nIt also appear some chars have corrupted to some extent £ has turned into \"£\" as an example.\r\n\r\nCheers\r\nDaz\r\n\r\n"}],"action":{"name":"View Issue","url":"https://github.com/geany/geany/issues/1540#issuecomment-316969139"}}}</script>