From boruch_baum at gmx.com Thu Mar 7 23:22:19 2019 From: boruch_baum at gmx.com (Boruch Baum) Date: Thu, 7 Mar 2019 16:22:19 -0500 Subject: kiwix - off-line wikipedia Message-ID: <20190307212219.xeco5guzjpw6kyun@E15-2016.optimum.net> I would normally post the core of this message to somewhere liwix-specific, but I find their project infrastructure and organization are so poor that I don't see any web-searchable resource for it. The kiwix[1] idea is great, and seems to be at least semi-officially supported by the wikimedia foundation. You can download a huge selection of wikimedia databases[2], including the many Hebrew ones, and use their local cross-platform GUI program or their localhost web-server to view. Works great... ... except for the database that everyone really wants, the complete english file 'wikipedia_en_all_novid_2018-10.zim'[3], which is probably very frustrating for all the people who spent hours or days downloading the 79 gigabyte file. Here are the issues, and the fix. Once the file is downloaded and checked against the md5sum link[4] on the download page, the kiwix program will indicate that the file is not a valid zim file. This seems to be because it was prepared with an incompatible zim version, but the only real reason is a single flipped bit in the file's "magic number". Change the bit, and the hours or days you spent downloading the file have been redeemed. Use your favorite hex editor to change the value of byte number five from '06' to '05'.In linux, to observe the issue, compare the file to a recognized zim file using 'xxd -l 5 [filename]'. And, when you perform the edit using your favorite hex editor, you probably don't want to rename the output file, since that would change the duration of the operation from instantaneous to however long it takes your system to copy 79 gigabytes. What worked for me was the debian ncurses program 'hexeditor'. Now you can use the kiwix GUI program to open the file and add it to your library. A second and very general issue is the quality of the project's documentation. For the purposes of this post, what's relevant is that in order to use the kiwix localhost web-server for a database, one seems to need to first open that zim file using the kiwix GUI program, which adds the database to the kiwix 'library'. Then you can start / restart the web-server and view / search the data. A third issue is a hiccup that seems to be misleading or just plain wrong in an error message produced by the kiwix web server. It will complain that it cannot open the search index for the 79Gb file. However, it does seem to perform "search ahead"s for that database just fine. Go figure. All in all, this has become a project that I love to hate. A great idea, with just enough awful in the code and in the support to remind me what it was like to be a computer user in the 1980's. references: [1] https://kiwix.org/ [2] https://wiki.kiwix.org/wiki/Content_in_all_languages [3] http://download.kiwix.org/zim/wikipedia_en_all_novid.zim.torrent Really. for a file this large, use the bittorrent option. [4] http://download.kiwix.org/zim/wikipedia_en_all_novid.zim.md5 -- hkp://keys.gnupg.net CA45 09B5 5351 7C11 A9D1 7286 0036 9E45 1595 8BC0 From levonshe at yandex.com Mon Mar 11 09:27:44 2019 From: levonshe at yandex.com (Lev Olshvang) Date: Mon, 11 Mar 2019 10:27:44 +0300 Subject: What will happen on attempt to write to read-only page when CONFIG_MEM_SOFT_DIRTY is off ? Message-ID: <21618991552289264@iva7-7c2970ec7645.qloud-c.yandex.net> Hello all, Please help me to clarify what will page fault handler do (if any) File arch/x86/include/asm/pgtable_types.h have following comment for 2 PAGE_DIRTY_BITs #define _PAGE_BIT_DIRTY 6 /* was written to (raised by CPU) */ _PAGE_BIT_SOFT_DIRTY _PAGE_BIT_SOFTW3 /* software dirty tracking */ While documentation clearly explains that Page Fault handler sets second flag https://www.kernel.org/doc/Documentation/vm/soft-dirty.txt I do not have idea what will happen when tracking Soft Dirty flags is off, I suppose the answer is in mm/gup.c but I was not able to track it to page handler. Thanks you all. Lev. From yturgema at redhat.com Mon Mar 18 15:42:18 2019 From: yturgema at redhat.com (Yuval Turgeman) Date: Mon, 18 Mar 2019 15:42:18 +0200 Subject: How come the initrd cpio archives are so large? In-Reply-To: References: Message-ID: You're only seeing the early microcode, to see the full content try /usr/lib/dracut/skipcpio initrd | gzip -d -| cpio -divu On Mon, Jan 21, 2019 at 12:48 PM Shlomi Fish wrote: > Hi all! > > root at telaviv1:~/initrd/good/unpack # ls -l ../img > -rw------- 1 root root 11419609 Jan 21 11:42 ../img > root at telaviv1:~/initrd/good/unpack # cpio -i < ../img > 26 blocks > root at telaviv1:~/initrd/good/unpack # du . > 16K ./kernel/x86/microcode > 20K ./kernel/x86 > 24K ./kernel > 32K . > root at telaviv1:~/initrd/good/unpack # > > > ==> why is the initrd cpio image so large in comparison to its contents? > > I am trying to debug this kernel bootup problem - > https://bugs.mageia.org/show_bug.cgi?id=24203 - it happens with all > kernels I tried - compiled from source or not except for those that were > prepared in the past. Any help would be appreciated. > > -- > Shlomi Fish http://www.shlomifish.org/ > > Buddha has the Chuck Norris nature. > > Please reply to list if it's a mailing list post - http://shlom.in/reply . > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -------------- next part -------------- An HTML attachment was scrubbed... URL: From d.s at daniel.shahaf.name Wed Mar 20 15:21:02 2019 From: d.s at daniel.shahaf.name (Daniel Shahaf) Date: Wed, 20 Mar 2019 09:21:02 -0400 Subject: Fwd: Debconf20 will be in... Message-ID: <1383080b-d841-47e0-95aa-74f7c0d1f13f@www.fastmail.com> tl;dr: the 2020 incarnation of Debconf (Debian's annual developers conference) will be held in Haifa. This is the second-next Debconf, following one scheduled for July 2019 in Brazil. Congratulations to the bid team :-) Daniel Daniel Lange wrote on Wed, 20 Mar 2019 13:02 +00:00: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > Dear DebConf members, > Dear friends of the conference, > > We have had two strong final bids for hosting DebConf20: > Haifa, Israel and Lisbon, Portugal. > > Within the DebConf committee and the wider DebConf team there have > been extensive discussions about Israel as a hosting country and we > acknowledge that there will be some members of Debian that prefer to > not travel to Israel for political reasons. > > Still the Committee felt the upsides of the bid were significant and > edged well over the Portuguese bid. But it was a close call. The five > member DebConf committee had a two hour final decision meeting and a > 3:2 vote in favor of Israel. > > So, congratulations, to the Israeli bid team: > Your mission, should you choose to accept it, is to host the Debian > Developer Conference 2020 in Haifa! > > To make life a bit easier for the many Debian members in Europe, and > those restricted in travel, we would like to have DebConf21 in Europe > again. The DebConf Committee therefore kindly asks the Portuguese team > to carry over their bid to 2021. As the location and attendee volume > are expected to be very challenging, we encourage long-term DebConf > team members to join their team, for 2021, to ensure it succeeds. We > hope the Brazilian team, once it has recovered from their DebConf, can > and will offer support to their language-siblings in Portugal. > > We look forward to seeing you all in Curitiba, 21 July ? 28 July 2019, > for DebConf19. > Registrations are open at https://debconf19.debconf.org/register/ . > > And, a year later, to seeing you in Haifa, Israel. > > Best regards, > Daniel > for the DebConf committee From kaplanlior at gmail.com Wed Mar 20 15:26:28 2019 From: kaplanlior at gmail.com (Lior Kaplan) Date: Wed, 20 Mar 2019 15:26:28 +0200 Subject: Debconf20 will be in... In-Reply-To: <1383080b-d841-47e0-95aa-74f7c0d1f13f@www.fastmail.com> References: <1383080b-d841-47e0-95aa-74f7c0d1f13f@www.fastmail.com> Message-ID: Credit for the bid mostly belongs to Tzafrir who led this for the past 6 months. On Wed, Mar 20, 2019 at 3:21 PM Daniel Shahaf wrote: > tl;dr: the 2020 incarnation of Debconf (Debian's annual developers > conference) will be held in Haifa. This is the second-next Debconf, > following one scheduled for July 2019 in Brazil. > > Congratulations to the bid team :-) > > Daniel > > > Daniel Lange wrote on Wed, 20 Mar 2019 13:02 +00:00: > > -----BEGIN PGP SIGNED MESSAGE----- > > Hash: SHA256 > > > > Dear DebConf members, > > Dear friends of the conference, > > > > We have had two strong final bids for hosting DebConf20: > > Haifa, Israel and Lisbon, Portugal. > > > > Within the DebConf committee and the wider DebConf team there have > > been extensive discussions about Israel as a hosting country and we > > acknowledge that there will be some members of Debian that prefer to > > not travel to Israel for political reasons. > > > > Still the Committee felt the upsides of the bid were significant and > > edged well over the Portuguese bid. But it was a close call. The five > > member DebConf committee had a two hour final decision meeting and a > > 3:2 vote in favor of Israel. > > > > So, congratulations, to the Israeli bid team: > > Your mission, should you choose to accept it, is to host the Debian > > Developer Conference 2020 in Haifa! > > > > To make life a bit easier for the many Debian members in Europe, and > > those restricted in travel, we would like to have DebConf21 in Europe > > again. The DebConf Committee therefore kindly asks the Portuguese team > > to carry over their bid to 2021. As the location and attendee volume > > are expected to be very challenging, we encourage long-term DebConf > > team members to join their team, for 2021, to ensure it succeeds. We > > hope the Brazilian team, once it has recovered from their DebConf, can > > and will offer support to their language-siblings in Portugal. > > > > We look forward to seeing you all in Curitiba, 21 July ? 28 July 2019, > > for DebConf19. > > Registrations are open at https://debconf19.debconf.org/register/ . > > > > And, a year later, to seeing you in Haifa, Israel. > > > > Best regards, > > Daniel > > for the DebConf committee > > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -------------- next part -------------- An HTML attachment was scrubbed... URL: From moshegrey at gmail.com Wed Mar 20 15:36:29 2019 From: moshegrey at gmail.com (moshe nahmias) Date: Wed, 20 Mar 2019 15:36:29 +0200 Subject: Debconf20 will be in... In-Reply-To: References: <1383080b-d841-47e0-95aa-74f7c0d1f13f@www.fastmail.com> Message-ID: congratulations! On Wed, Mar 20, 2019 at 3:27 PM Lior Kaplan wrote: > Credit for the bid mostly belongs to Tzafrir who led this for the past 6 > months. > > On Wed, Mar 20, 2019 at 3:21 PM Daniel Shahaf > wrote: > >> tl;dr: the 2020 incarnation of Debconf (Debian's annual developers >> conference) will be held in Haifa. This is the second-next Debconf, >> following one scheduled for July 2019 in Brazil. >> >> Congratulations to the bid team :-) >> >> Daniel >> >> >> Daniel Lange wrote on Wed, 20 Mar 2019 13:02 +00:00: >> > -----BEGIN PGP SIGNED MESSAGE----- >> > Hash: SHA256 >> > >> > Dear DebConf members, >> > Dear friends of the conference, >> > >> > We have had two strong final bids for hosting DebConf20: >> > Haifa, Israel and Lisbon, Portugal. >> > >> > Within the DebConf committee and the wider DebConf team there have >> > been extensive discussions about Israel as a hosting country and we >> > acknowledge that there will be some members of Debian that prefer to >> > not travel to Israel for political reasons. >> > >> > Still the Committee felt the upsides of the bid were significant and >> > edged well over the Portuguese bid. But it was a close call. The five >> > member DebConf committee had a two hour final decision meeting and a >> > 3:2 vote in favor of Israel. >> > >> > So, congratulations, to the Israeli bid team: >> > Your mission, should you choose to accept it, is to host the Debian >> > Developer Conference 2020 in Haifa! >> > >> > To make life a bit easier for the many Debian members in Europe, and >> > those restricted in travel, we would like to have DebConf21 in Europe >> > again. The DebConf Committee therefore kindly asks the Portuguese team >> > to carry over their bid to 2021. As the location and attendee volume >> > are expected to be very challenging, we encourage long-term DebConf >> > team members to join their team, for 2021, to ensure it succeeds. We >> > hope the Brazilian team, once it has recovered from their DebConf, can >> > and will offer support to their language-siblings in Portugal. >> > >> > We look forward to seeing you all in Curitiba, 21 July ? 28 July 2019, >> > for DebConf19. >> > Registrations are open at https://debconf19.debconf.org/register/ . >> > >> > And, a year later, to seeing you in Haifa, Israel. >> > >> > Best regards, >> > Daniel >> > for the DebConf committee >> >> _______________________________________________ >> Linux-il mailing list >> Linux-il at cs.huji.ac.il >> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il >> > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -------------- next part -------------- An HTML attachment was scrubbed... URL: From levonshe at yandex.com Wed Mar 20 15:42:39 2019 From: levonshe at yandex.com (Lev Olshvang) Date: Wed, 20 Mar 2019 16:42:39 +0300 Subject: What will happen if 2 processes map same physical page Message-ID: <6967041553089359@myt2-66bcb87429e6.qloud-c.yandex.net> Hi all, The question is it ipossiblle in Linux/MMU/TLB that 2 processes map to the same physical address? Will CPU or TLB discover that second process tries to reach occupied physical page? What if first process set page permission to read and second whats to write to this page ? Perhaps during context switch all page access permissions of first process is flashed out from MMU ? I confess I do not know what exactly happens in TLB and between Linux and hardware view of pages. I am particularly intereste in ARMv7, perhaps its architecture have some solutions to these question. Regards, Lev From d.s at daniel.shahaf.name Wed Mar 20 15:43:44 2019 From: d.s at daniel.shahaf.name (Daniel Shahaf) Date: Wed, 20 Mar 2019 09:43:44 -0400 Subject: Debconf20 will be in... In-Reply-To: References: <1383080b-d841-47e0-95aa-74f7c0d1f13f@www.fastmail.com> Message-ID: moshe nahmias wrote on Wed, 20 Mar 2019 13:37 +00:00: > congratulations! > > On Wed, Mar 20, 2019 at 3:27 PM Lior Kaplan wrote: > > Credit for the bid mostly belongs to Tzafrir who led this for the past 6 months. > > Kudos! @Bid team ? any help needed with organizing? Cheers, Daniel > > On Wed, Mar 20, 2019 at 3:21 PM Daniel Shahaf wrote: > >> tl;dr: the 2020 incarnation of Debconf (Debian's annual developers > >> conference) will be held in Haifa. This is the second-next Debconf, > >> following one scheduled for July 2019 in Brazil. From joshroden at gmail.com Thu Mar 21 11:52:13 2019 From: joshroden at gmail.com (Josh Roden) Date: Thu, 21 Mar 2019 11:52:13 +0200 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. Message-ID: Hi everyone, Happy Purim! We're looking for a Linux editor for first year CS students that is light on resources. Thanks, Josh -------------- next part -------------- An HTML attachment was scrubbed... URL: From levonshe at yandex.com Thu Mar 21 11:56:17 2019 From: levonshe at yandex.com (Lev Olshvang) Date: Thu, 21 Mar 2019 12:56:17 +0300 Subject: What will happen if 2 processes map same physical page In-Reply-To: <16760.1553101675@turing-police> References: <6967041553089359@myt2-66bcb87429e6.qloud-c.yandex.net> <16760.1553101675@turing-police> Message-ID: <3935481553162177@sas2-ce04c18c415c.qloud-c.yandex.net> Hi Vaaldis, Thanks for answer, I still wondering whether the kernel will allow write to a read-only page of shared library while it has mapped to several processes? Kernel knows that page's reference count >1, will it allow mmap/mprotect to change page protection ? Or will it allow direct right by physical address? I suppose that CPU should raise page fault when write is made to read only page, What is the sequence CPU raises page faul before write to page of after data is written Will CPU wait until kernel will consider what to do , whether agree and change PTE "writable " bit to 1 ? Or kernel may disagree and raise SEGFAULT? I checked in the handle_mm_fault() calls for arch_vma_access_permitted() which just returns true on most architectures which is very strange and contradicts my prediction of SEFFAULT. arch_vma_access_permitted() retutus true when is sees that access is made from foreign process? https://elixir.bootlin.com/linux/latest/ident/arch_vma_access_permitted I am totally confused. What do you think ? Regards, Lev 20.03.2019, 20:08, "Valdis Kl?tnieks" : > On Wed, 20 Mar 2019 16:42:39 +0300, Lev Olshvang said: >> ?The question is it ipossiblle in Linux/MMU/TLB that 2 processes map to >> ?the same physical address? > > Totally possible. That's how mmap shared memory works, and why shared > libraries are possible. > >> ?Will CPU or TLB discover that second process tries to reach occupied physical page? > > Well, the hardware won't discover it as a "second" process, it only knows it's > processing *this* memory access. > >> ?What if first process set page permission to read and second whats to write to this page ? > > Perfectly OK - the two processes have separate page table mappings, with > separate permission bits. So (for example) physical page 0x17F000 is mapped to > virtual address 0x2034D000 with read-only permission n process 1's page tables, > and to virtual address 0x98FF3000 with read-write permission in process 2's > page tables. No problem. > > (And before you ask, yes it's possible for process 2 to running on one core > doing a write to the page at the exact same time that process 1 is doing a read > on another core. Depending on the hardware cache design, this may or may not > get process 1 updated data. This is why locking and memory barriers are > important. See Documentation/memory-barriers.txt for more details) > > "And then there's the Alpha" - a processor design that got much of its speed by > being weird about this stuff. :) > >> ?Perhaps during context switch all page access permissions of first process is >> ?flashed out from MMU ? > > Actually, the kernel just points the MMU at a new set of page table entries and lets > the TLB reload as needed. In particular, on most architectures, the kernel tries really > hard to ensure that all processes share at least part of their page table mappings so > the kernel is always mapped at the same place, meaning that there's a better chance > that on a syscall, the TLB already has hot entries for large parts of the kernel so no > TLB reloads are needed. From shlomif at gmail.com Thu Mar 21 12:26:00 2019 From: shlomif at gmail.com (Shlomi Fish) Date: Thu, 21 Mar 2019 12:26:00 +0200 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: Hi Josh! On Thu, Mar 21, 2019 at 11:53 AM Josh Roden wrote: > Hi everyone, > Happy Purim! > We're looking for a Linux editor for first year CS students > that is light on resources. > How much light? People used to complain about emacs needing more than 8 megabytes of RAM... Anyway, see https://www.shlomifish.org/open-source/resources/editors-and-IDEs/ . > Thanks, > Josh > > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -- Shlomi Fish http://www.shlomifish.org/ Buddha has the Chuck Norris nature. Please reply to list if it's a mailing list post - http://shlom.in/reply . -------------- next part -------------- An HTML attachment was scrubbed... URL: From govershay at gmail.com Thu Mar 21 12:40:46 2019 From: govershay at gmail.com (Shay Gover) Date: Thu, 21 Mar 2019 12:40:46 +0200 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: As far as I know only eclipse support both. On Thu, Mar 21, 2019 at 12:26 PM Shlomi Fish wrote: > Hi Josh! > > On Thu, Mar 21, 2019 at 11:53 AM Josh Roden wrote: > >> Hi everyone, >> Happy Purim! >> We're looking for a Linux editor for first year CS students >> that is light on resources. >> > > How much light? People used to complain about emacs needing more than 8 > megabytes of RAM... > Anyway, see > https://www.shlomifish.org/open-source/resources/editors-and-IDEs/ . > > >> Thanks, >> Josh >> >> _______________________________________________ >> Linux-il mailing list >> Linux-il at cs.huji.ac.il >> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il >> > > > -- > Shlomi Fish http://www.shlomifish.org/ > > Buddha has the Chuck Norris nature. > > Please reply to list if it's a mailing list post - http://shlom.in/reply . > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -------------- next part -------------- An HTML attachment was scrubbed... URL: From elylevy at cs.huji.ac.il Thu Mar 21 12:43:49 2019 From: elylevy at cs.huji.ac.il (Ely Levy) Date: Thu, 21 Mar 2019 12:43:49 +0200 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: We give jetbrains to our first year students. We used to let then use emacs but I think jetbrains was more comfortable for them. Ely On Thu, Mar 21, 2019, 12:41 Shay Gover wrote: > As far as I know only eclipse support both. > > On Thu, Mar 21, 2019 at 12:26 PM Shlomi Fish wrote: > >> Hi Josh! >> >> On Thu, Mar 21, 2019 at 11:53 AM Josh Roden wrote: >> >>> Hi everyone, >>> Happy Purim! >>> We're looking for a Linux editor for first year CS students >>> that is light on resources. >>> >> >> How much light? People used to complain about emacs needing more than 8 >> megabytes of RAM... >> Anyway, see >> https://www.shlomifish.org/open-source/resources/editors-and-IDEs/ . >> >> >>> Thanks, >>> Josh >>> >>> _______________________________________________ >>> Linux-il mailing list >>> Linux-il at cs.huji.ac.il >>> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il >>> >> >> >> -- >> Shlomi Fish http://www.shlomifish.org/ >> >> Buddha has the Chuck Norris nature. >> >> Please reply to list if it's a mailing list post - http://shlom.in/reply >> . >> _______________________________________________ >> Linux-il mailing list >> Linux-il at cs.huji.ac.il >> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il >> > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -------------- next part -------------- An HTML attachment was scrubbed... URL: From nad.oby at gmail.com Thu Mar 21 17:55:24 2019 From: nad.oby at gmail.com (Evgeniy Ginzburg) Date: Thu, 21 Mar 2019 16:55:24 +0100 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: Hello Josh. I'll try to answer the question that you not really asked. The problem with lightweight editors (best ones are variants of Vim or Emacs) that making them work "good" for Java coding is a very non-trivial task. Especially if you want any debugging, code navigation and/or snippets. (Also if anybody can point me to a good configuration example for Java/Scala in Vim or Emacs I'll be eternally grateful.) C/C++ is easier in this case. Still, making ctags(or equivalent) and GDB to work under Vim or Emacs is not the 5 minutes task. And one will need to integrate some kind of build system make, cmake, etc... Whoever is going to do this will need to know exactly what he wants, and this is not expected from the first year student. And also I assume that you'd prefer a solution that "Just works (TM)". Then your choices are limited to full-fledged IDEs, and those are not in any way lightweight. >From my point of view, Netbeans is just a little bit lighter than Eclipse on resources, but this is just a matter of personal taste. Best regards Evgeniy. On Thu, Mar 21, 2019 at 10:53 AM Josh Roden wrote: > Hi everyone, > Happy Purim! > We're looking for a Linux editor for first year CS students > that is light on resources. > Thanks, > Josh > > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -- So long, and thanks for all the fish. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dannyl at software.co.il Thu Mar 21 17:57:10 2019 From: dannyl at software.co.il (dannyl L) Date: Thu, 21 Mar 2019 17:57:10 +0200 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: Atom On Thu, 21 Mar 2019, 11:53 AM Josh Roden, wrote: > Hi everyone, > Happy Purim! > We're looking for a Linux editor for first year CS students > that is light on resources. > Thanks, > Josh > > _______________________________________________ > Linux-il mailing list > Linux-il at cs.huji.ac.il > http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il > -------------- next part -------------- An HTML attachment was scrubbed... URL: From nad.oby at gmail.com Thu Mar 21 17:59:57 2019 From: nad.oby at gmail.com (Evgeniy Ginzburg) Date: Thu, 21 Mar 2019 16:59:57 +0100 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: Forgot the JetBrains mentioned here On Thu, Mar 21, 2019 at 4:55 PM Evgeniy Ginzburg wrote: > Hello Josh. > I'll try to answer the question that you not really asked. > > The problem with lightweight editors (best ones are variants of Vim or > Emacs) that making them work "good" for Java coding is a very non-trivial > task. > Especially if you want any debugging, code navigation and/or snippets. > (Also if anybody can point me to a good configuration example for > Java/Scala in Vim or Emacs I'll be eternally grateful.) > > C/C++ is easier in this case. > Still, making ctags(or equivalent) and GDB to work under Vim or Emacs is > not the 5 minutes task. > And one will need to integrate some kind of build system make, cmake, > etc... > Whoever is going to do this will need to know exactly what he wants, and > this is not expected from the first year student. > > And also I assume that you'd prefer a solution that "Just works (TM)". > > Then your choices are limited to full-fledged IDEs, and those are not in > any way lightweight. > From my point of view, Netbeans is just a little bit lighter than Eclipse > on resources, but this is just a matter of personal taste. > > Best regards Evgeniy. > > On Thu, Mar 21, 2019 at 10:53 AM Josh Roden wrote: > >> Hi everyone, >> Happy Purim! >> We're looking for a Linux editor for first year CS students >> that is light on resources. >> Thanks, >> Josh >> >> _______________________________________________ >> Linux-il mailing list >> Linux-il at cs.huji.ac.il >> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il >> > > > -- > So long, and thanks for all the fish. > -- So long, and thanks for all the fish. -------------- next part -------------- An HTML attachment was scrubbed... URL: From levonshe at yandex.com Fri Mar 22 11:15:49 2019 From: levonshe at yandex.com (Lev Olshvang) Date: Fri, 22 Mar 2019 12:15:49 +0300 Subject: What will happen if 2 processes map same physical page In-Reply-To: <20190321104528.33471e38@narunkot> References: <6967041553089359@myt2-66bcb87429e6.qloud-c.yandex.net> <16760.1553101675@turing-police> <3935481553162177@sas2-ce04c18c415c.qloud-c.yandex.net> <20190321104528.33471e38@narunkot> Message-ID: <2235291553246149@sas1-0a6c2e2b59d7.qloud-c.yandex.net> Hello Okash, Actually there were 3 question: Third question is : Is there any way to tell the kernel that PTE of same physical page should be equal in all processes? For example, shared lib mapped from different processes to same physical page must have same PTE, isn it? And the presence of SELinux feature SELINUX_CHECKREQPROT_VALUE indicates for me that kernel somehow knows the correct page protections. (although I do not see in code how it is done) But the question might be rephrased : IMHO Kernel should mandate same PTE flags no matter how many virtual mapping were made to the same physical page. What do you think? 21.03.2019, 13:45, "Okash Khawaja" : > On Thu, 21 Mar 2019 12:56:17 +0300 > Lev Olshvang wrote: > >> ?Hi Vaaldis, >> >> ?Thanks for answer, >> ?I still wondering whether the kernel will allow write to a read-only >> ?page of shared library while it has mapped to several processes? >> ?Kernel knows that page's reference count >1, will it allow >> ?mmap/mprotect to change page protection ? Or will it allow direct >> ?right by physical address? I suppose that CPU should raise page fault >> ?when write is made to read only page, >> >> ?What is the sequence CPU raises page faul before write to page of >> ?after data is written Will CPU wait until kernel will consider what >> ?to do , whether agree and change PTE "writable " bit to 1 ? Or >> ?kernel may disagree and raise SEGFAULT? > > Note that each process has its own PTE. So PTE in one process may say > the page is writable and PTE in another process may say it's read-only. > >> ?I checked in the handle_mm_fault() calls for >> ?arch_vma_access_permitted() which just returns true on most >> ?architectures which is very strange and contradicts my prediction of >> ?SEFFAULT. arch_vma_access_permitted() retutus true when is sees that >> ?access is made from foreign process? >> ?https://elixir.bootlin.com/linux/latest/ident/arch_vma_access_permitted >> >> ?I am totally confused. >> >> ?What do you think ? >> >> ?Regards, >> ?Lev > > It looks like there are two separate questions in the email. > > 1) Will kernel allow the same physical page to be mapped as read-only > in one process and as read-write in another process? > > 2) How page fault is generated? > > Answer for first is yes. Same physical page can be mapped with > different permissions in two different processes. It means read-only > process will ultimately (hopefully very soon) notice changes made by > read-write process. > > Answer for second question is a bit complicated. However there is a > trick to it. Once we know that, rest will become clear automaticaly. > The trick (at least for x86 systems) is that permissions are maintained > at two different levels: > > - VMA level > - PTE level (or PUD level for larger page size but that is not relevant > ??here) > > When a page in memory is accessed, permission on corresponding VMA is > checked first. If the access is allowed by VMA then PTE permissions are > checked. Otherwise segfault is generated. If permissions at PTE level > don't match the access type then a page fault is generated. That's when > page fault hander kicks in and tries to resolve the problem by faulting > the page into RAM, copying the page in RAM (for copy-on-write) etc. > >> ?20.03.2019, 20:08, "Valdis Kl?tnieks" : >> ?> On Wed, 20 Mar 2019 16:42:39 +0300, Lev Olshvang said: >> ?>> ?The question is it ipossiblle in Linux/MMU/TLB that 2 processes >> ?>> map to the same physical address? >> ?> >> ?> Totally possible. That's how mmap shared memory works, and why >> ?> shared libraries are possible. >> ?> >> ?>> ?Will CPU or TLB discover that second process tries to reach >> ?>> occupied physical page? >> ?> >> ?> Well, the hardware won't discover it as a "second" process, it only >> ?> knows it's processing *this* memory access. >> ?> >> ?>> ?What if first process set page permission to read and second >> ?>> whats to write to this page ? >> ?> >> ?> Perfectly OK - the two processes have separate page table mappings, >> ?> with separate permission bits. So (for example) physical page >> ?> 0x17F000 is mapped to virtual address 0x2034D000 with read-only >> ?> permission n process 1's page tables, and to virtual address >> ?> 0x98FF3000 with read-write permission in process 2's page tables. >> ?> No problem. >> ?> >> ?> (And before you ask, yes it's possible for process 2 to running on >> ?> one core doing a write to the page at the exact same time that >> ?> process 1 is doing a read on another core. Depending on the >> ?> hardware cache design, this may or may not get process 1 updated >> ?> data. This is why locking and memory barriers are important. See >> ?> Documentation/memory-barriers.txt for more details) >> ?> >> ?> "And then there's the Alpha" - a processor design that got much of >> ?> its speed by being weird about this stuff. :) >> ?> >> ?>> ?Perhaps during context switch all page access permissions of >> ?>> first process is flashed out from MMU ? >> ?> >> ?> Actually, the kernel just points the MMU at a new set of page table >> ?> entries and lets the TLB reload as needed. In particular, on most >> ?> architectures, the kernel tries really hard to ensure that all >> ?> processes share at least part of their page table mappings so the >> ?> kernel is always mapped at the same place, meaning that there's a >> ?> better chance that on a syscall, the TLB already has hot entries >> ?> for large parts of the kernel so no TLB reloads are needed. >> >> ?_______________________________________________ >> ?Kernelnewbies mailing list >> ?Kernelnewbies at kernelnewbies.org >> ?https://lists.kernelnewbies.org/mailman/listinfo/kernelnewbies From levonshe at yandex.com Mon Mar 25 21:54:41 2019 From: levonshe at yandex.com (Lev Olshvang) Date: Mon, 25 Mar 2019 22:54:41 +0300 Subject: Which Ubuntu toolchains is better compiling andeoid ARM kernel Message-ID: <2385641553543681@iva7-634c9cb1f49d.qloud-c.yandex.net> There are 2 toolchain available in Ubuntu 16 : gcc-arm-linux-androideabi and gcc-arm-linux-gnueabihf I confess I do not understand which is correct one for ARMv7.1 level 10 when compiling kernel Clearly gcc-arm-linux-androideabi is built with Bionic libc so it must be used to compile applications When I tried to compile kernel 4.9 with this toolchain it terminated with error specific for 4.9 and I patched Makefile.build https://patchwork.kernel.org/patch/9412009/ Then it works almost till the end arm-linux-androideabi-ld: warning: unwinding may not work because EXIDX input section 609 of net/built-in.o is not in EXIDX output section arm-linux-androideabi-ld: error: missing CPU support I compiled kernel using gcc-arm-linux-gnueabihf toolchain with no problem, but device did not boot and was stuck before shoeing even kernel uncompressing line. So I wonder perhaps I need to solve androideabi problem? Regards, Lev From const at makelinux.co.il Sun Mar 31 14:13:17 2019 From: const at makelinux.co.il (Constantine Shulyupin) Date: Sun, 31 Mar 2019 14:13:17 +0300 Subject: bank statement import and analysis Message-ID: Hi all, Is there an utility (preferable on python) for importing and analyzing Israel banks statements in formats Bankin.dat, csv, xls/xml ? Thanks -- Constantine Shulyupin -------------- next part -------------- An HTML attachment was scrubbed... URL: From borissh1983 at gmail.com Sun Mar 31 14:26:21 2019 From: borissh1983 at gmail.com (borissh1983 at gmail.com) Date: Sun, 31 Mar 2019 14:26:21 +0300 Subject: bank statement import and analysis References: Message-ID: <2062069.M32BmSYerg@beast> On Sunday, 31 March 2019 14:13:17 IDT Constantine Shulyupin wrote: > Hi all, > > Is there an utility (preferable on python) for importing and analyzing > Israel banks statements in formats Bankin.dat, csv, xls/xml ? > > Thanks You need to be more specfic : There is the clearing house protocol (inner bank) that is used for automated bank transfers, but it is Bank specific format for the enum values interpretation. There is the MASAV data ( https://www.boi.org.il/en/PaymentSystem/ ActiveClearingHousesInIsrael/Pages/ClearingHouse.aspx ). There is customer level output (bank specific) which include CSV (example baruch.ev-en.org/proj/gnucash.html ) There is the QIF format and friends From joshroden at gmail.com Sun Mar 31 14:46:35 2019 From: joshroden at gmail.com (Josh Roden) Date: Sun, 31 Mar 2019 14:46:35 +0300 Subject: Suggestion for java/c++ editor with compile, run and debug capabilities. In-Reply-To: References: Message-ID: Hi I installed Geany. It works both with Java and C++. Using Geany with GDB seems problematic but I figure that it's a good bet for 1st year students to get started. Thank you all for your suggestions! On Thu, Mar 21, 2019 at 6:00 PM Evgeniy Ginzburg wrote: > Forgot the JetBrains mentioned here > > On Thu, Mar 21, 2019 at 4:55 PM Evgeniy Ginzburg > wrote: > >> Hello Josh. >> I'll try to answer the question that you not really asked. >> >> The problem with lightweight editors (best ones are variants of Vim or >> Emacs) that making them work "good" for Java coding is a very non-trivial >> task. >> Especially if you want any debugging, code navigation and/or snippets. >> (Also if anybody can point me to a good configuration example for >> Java/Scala in Vim or Emacs I'll be eternally grateful.) >> >> C/C++ is easier in this case. >> Still, making ctags(or equivalent) and GDB to work under Vim or Emacs is >> not the 5 minutes task. >> And one will need to integrate some kind of build system make, cmake, >> etc... >> Whoever is going to do this will need to know exactly what he wants, and >> this is not expected from the first year student. >> >> And also I assume that you'd prefer a solution that "Just works (TM)". >> >> Then your choices are limited to full-fledged IDEs, and those are not in >> any way lightweight. >> From my point of view, Netbeans is just a little bit lighter than Eclipse >> on resources, but this is just a matter of personal taste. >> >> Best regards Evgeniy. >> >> On Thu, Mar 21, 2019 at 10:53 AM Josh Roden wrote: >> >>> Hi everyone, >>> Happy Purim! >>> We're looking for a Linux editor for first year CS students >>> that is light on resources. >>> Thanks, >>> Josh >>> >>> _______________________________________________ >>> Linux-il mailing list >>> Linux-il at cs.huji.ac.il >>> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il >>> >> >> >> -- >> So long, and thanks for all the fish. >> > > > -- > So long, and thanks for all the fish. > -------------- next part -------------- An HTML attachment was scrubbed... URL: From borissh1983 at gmail.com Sun Mar 31 15:19:45 2019 From: borissh1983 at gmail.com (borissh1983 at gmail.com) Date: Sun, 31 Mar 2019 15:19:45 +0300 Subject: bank statement import and analysis References: <2062069.M32BmSYerg@beast> Message-ID: <1569887.Y0K5CD2vqR@beast> On Sunday, 31 March 2019 14:26:21 IDT borissh1983 at gmail.com wrote: > On Sunday, 31 March 2019 14:13:17 IDT Constantine Shulyupin wrote: > > Hi all, > > > > Is there an utility (preferable on python) for importing and analyzing > > Israel banks statements in formats Bankin.dat, csv, xls/xml ? > > > > Thanks > > You need to be more specfic : > > There is the clearing house protocol (inner bank) that is used for automated > bank transfers, but it is Bank specific format for the enum values > interpretation. > > There is the MASAV data ( https://www.boi.org.il/en/PaymentSystem/ > ActiveClearingHousesInIsrael/Pages/ClearingHouse.aspx ). > > There is customer level output (bank specific) which include CSV (example > baruch.ev-en.org/proj/gnucash.html ) > TBH I didn't use Baruch's script. I just found it while I was searching for a convertion to QIF which gnucash can handle. From borissh1983 at gmail.com Sun Mar 31 21:39:15 2019 From: borissh1983 at gmail.com (borissh1983 at gmail.com) Date: Sun, 31 Mar 2019 21:39:15 +0300 Subject: Why MTA-STS is so rarely used with local e-mail servers ? Message-ID: <2423903.FBoqQW2aCk@beast> Hi, In the last few days I was trying to figure how many ("home run" , "small businesses" or academic ) domains had setup MTA-STS . Out of 20 domains on this and other mailing lists; only two had MTA-STS. I have seen that gmail, outlook and gmx have it, but they are not small nor home run. As for domains that use providers with MTA-STS, I may be wrong, but It does not seem that the domains that use such providers had setup delegation. ( https://tools.ietf.org/html/ rfc8461#section-8.2 ) . Why is it so rarely used ? Why customers of providers that provide MTA-STS do not setup it for their own domain ? Test for domain.seclvl.cctld done by : 1.Check if there for txt record for _mta-sts.domain.seclvl.cctld dig +short -t txt _mta-sts.domain.seclvl.cctld positive result : "v=STSv1; id=20190101T020202;" negative result: no result. 2. fetching .well-known/mta-sts.txt Good result : version: STSv1 mode: testing mx: smtp.domain.seclvl.cctld max_age: 86400 bad result: HTTP 404, 403 etc .. p.s. the RFC itself https://tools.ietf.org/html/rfc8461